2026-02-12T22:52:44.256 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:52:44.275 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:52:44.356 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47325 branch: wip-pdonnell-testing-20260210.171210 description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/admin} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47325' kernel: client: sha1: distro sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: lockdep: true ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - missing required features - \(MDS_CACHE_OVERSIZED\) - \(MDS_TRIM\) - \(MDS_CLIENTS_BROKEN_ROOTSQUASH\) - report clients with broken root_squash implementation - evicting unresponsive client - as file system flag refuse_client_session is set sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: syntax: v1 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVU+yjmJLqvqCNeVX/PSuZgIEh++LfZm8+BmB+mrCrEN8jS/CItO4SRWL6Ix5iaUUd4M/BHZkpuY4N0yeynUkE= trial185.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrKctNUChAtUbyxaGE3DvQyokhzq+cKOisps0LdIEvN2nnv+ZpAvo7cEUCPHzQcC0F7ggqei3vNORkTcc0kMoU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - kclient: null - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_admin - tasks.cephfs.admin.test_fs_swap teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:52:44.356 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:52:44.356 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:52:44.356 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:52:44.358 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:52:44.358 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:52:44.358 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:52:44.358 INFO:teuthology.packaging:ref: None 2026-02-12T22:52:44.358 INFO:teuthology.packaging:tag: None 2026-02-12T22:52:44.358 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:52:44.358 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:52:44.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:52:44.481 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:52:44.482 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:52:44.493 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:52:44.493 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:52:44.520 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:52:44.540 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:52:44.552 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:52:44.630 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial149.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47325', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:49:18.215638', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVU+yjmJLqvqCNeVX/PSuZgIEh++LfZm8+BmB+mrCrEN8jS/CItO4SRWL6Ix5iaUUd4M/BHZkpuY4N0yeynUkE='} 2026-02-12T22:52:44.685 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial185.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47325', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:49:18.215014', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrKctNUChAtUbyxaGE3DvQyokhzq+cKOisps0LdIEvN2nnv+ZpAvo7cEUCPHzQcC0F7ggqei3vNORkTcc0kMoU='} 2026-02-12T22:52:44.685 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:52:44.698 INFO:teuthology.task.internal:roles: ubuntu@trial149.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2026-02-12T22:52:44.699 INFO:teuthology.task.internal:roles: ubuntu@trial185.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2026-02-12T22:52:44.699 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:52:44.834 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7df3e858efc0>, signals=[15]) 2026-02-12T22:52:44.834 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:52:44.845 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:52:44.845 DEBUG:teuthology.task.internal:connecting to ubuntu@trial149.front.sepia.ceph.com 2026-02-12T22:52:44.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.906 DEBUG:teuthology.task.internal:connecting to ubuntu@trial185.front.sepia.ceph.com 2026-02-12T22:52:44.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.970 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:52:44.981 DEBUG:teuthology.orchestra.run.trial149:> uname -m 2026-02-12T22:52:44.999 INFO:teuthology.orchestra.run.trial149.stdout:x86_64 2026-02-12T22:52:44.999 DEBUG:teuthology.orchestra.run.trial149:> cat /etc/os-release 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:NAME="Rocky Linux" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:ID="rocky" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:VERSION_ID="10.1" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:ANSI_COLOR="0;32" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:52:45.055 INFO:teuthology.orchestra.run.trial149.stdout:VENDOR_NAME="RESF" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:52:45.056 INFO:teuthology.orchestra.run.trial149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:52:45.056 INFO:teuthology.lock.ops:Updating trial149.front.sepia.ceph.com on lock server 2026-02-12T22:52:45.128 DEBUG:teuthology.orchestra.run.trial185:> uname -m 2026-02-12T22:52:45.145 INFO:teuthology.orchestra.run.trial185.stdout:x86_64 2026-02-12T22:52:45.145 DEBUG:teuthology.orchestra.run.trial185:> cat /etc/os-release 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:NAME="Rocky Linux" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:ID="rocky" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_ID="10.1" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:ANSI_COLOR="0;32" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:VENDOR_NAME="RESF" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:52:45.202 INFO:teuthology.orchestra.run.trial185.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:52:45.203 INFO:teuthology.orchestra.run.trial185.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:52:45.203 INFO:teuthology.orchestra.run.trial185.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:52:45.203 INFO:teuthology.orchestra.run.trial185.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:52:45.203 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:52:45.203 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:52:45.203 INFO:teuthology.lock.ops:Updating trial185.front.sepia.ceph.com on lock server 2026-02-12T22:52:45.286 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:52:45.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:52:45.311 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:52:45.311 DEBUG:teuthology.orchestra.run.trial149:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:52:45.312 DEBUG:teuthology.orchestra.run.trial185:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:52:45.330 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:52:45.341 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:52:45.341 DEBUG:teuthology.orchestra.run.trial149:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:52:45.369 DEBUG:teuthology.orchestra.run.trial185:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:52:45.384 INFO:teuthology.orchestra.run.trial149.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:52:45.387 INFO:teuthology.orchestra.run.trial185.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:52:45.388 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:52:45.554 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:52:45.573 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': 'distro'} 2026-02-12T22:52:45.573 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2026-02-12T22:52:45.573 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:52:45.574 DEBUG:teuthology.orchestra.run.trial149:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:52:45.574 DEBUG:teuthology.orchestra.run.trial185:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:52:45.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:52:45.590 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:52:45.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:52:45.591 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:52:45.647 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.647 INFO:teuthology.task.kernel:Running kernel on trial149: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.647 DEBUG:teuthology.orchestra.run.trial149:> sudo yum install -y kernel 2026-02-12T22:52:45.648 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.648 INFO:teuthology.task.kernel:Running kernel on trial185: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.648 DEBUG:teuthology.orchestra.run.trial185:> sudo yum install -y kernel 2026-02-12T22:52:46.140 INFO:teuthology.orchestra.run.trial149.stdout:Rocky Linux 10 - AppStream 23 MB/s | 2.2 MB 00:00 2026-02-12T22:52:46.149 INFO:teuthology.orchestra.run.trial185.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:52:46.447 INFO:teuthology.orchestra.run.trial149.stdout:Rocky Linux 10 - BaseOS 60 MB/s | 11 MB 00:00 2026-02-12T22:52:46.469 INFO:teuthology.orchestra.run.trial185.stdout:Rocky Linux 10 - BaseOS 57 MB/s | 11 MB 00:00 2026-02-12T22:52:46.933 INFO:teuthology.orchestra.run.trial149.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 507 kB 00:00 2026-02-12T22:52:46.949 INFO:teuthology.orchestra.run.trial185.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 507 kB 00:00 2026-02-12T22:52:47.424 INFO:teuthology.orchestra.run.trial185.stdout:Extra Packages for Enterprise Linux 15 MB/s | 6.2 MB 00:00 2026-02-12T22:52:47.571 INFO:teuthology.orchestra.run.trial149.stdout:Extra Packages for Enterprise Linux 11 MB/s | 6.2 MB 00:00 2026-02-12T22:52:48.095 INFO:teuthology.orchestra.run.trial185.stdout:lab-extras 169 kB/s | 3.7 kB 00:00 2026-02-12T22:52:48.226 INFO:teuthology.orchestra.run.trial149.stdout:lab-extras 302 kB/s | 3.7 kB 00:00 2026-02-12T22:52:48.510 INFO:teuthology.orchestra.run.trial185.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:52:48.522 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-12T22:52:48.523 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-12T22:52:48.523 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-12T22:52:48.523 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout:Installing dependencies: 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-12T22:52:48.524 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-12T22:52:48.525 INFO:teuthology.orchestra.run.trial185.stdout:Install 5 Packages 2026-02-12T22:52:48.525 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-12T22:52:48.525 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 93 M 2026-02-12T22:52:48.525 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 135 M 2026-02-12T22:52:48.525 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-12T22:52:48.578 INFO:teuthology.orchestra.run.trial185.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:52:48.638 INFO:teuthology.orchestra.run.trial149.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:52:48.650 INFO:teuthology.orchestra.run.trial149.stdout:Dependencies resolved. 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout:================================================================================ 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout: Package Arch Version Repo Size 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout:================================================================================ 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout:Installing: 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout:Installing dependencies: 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:52:48.651 INFO:teuthology.orchestra.run.trial149.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout: 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout:Transaction Summary 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout:================================================================================ 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout:Install 5 Packages 2026-02-12T22:52:48.652 INFO:teuthology.orchestra.run.trial149.stdout: 2026-02-12T22:52:48.653 INFO:teuthology.orchestra.run.trial149.stdout:Total download size: 93 M 2026-02-12T22:52:48.653 INFO:teuthology.orchestra.run.trial149.stdout:Installed size: 135 M 2026-02-12T22:52:48.653 INFO:teuthology.orchestra.run.trial149.stdout:Downloading Packages: 2026-02-12T22:52:48.704 INFO:teuthology.orchestra.run.trial149.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:52:48.784 INFO:teuthology.orchestra.run.trial185.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 71 MB/s | 18 MB 00:00 2026-02-12T22:52:48.836 INFO:teuthology.orchestra.run.trial185.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 54 MB/s | 2.8 MB 00:00 2026-02-12T22:52:48.926 INFO:teuthology.orchestra.run.trial149.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 67 MB/s | 18 MB 00:00 2026-02-12T22:52:48.975 INFO:teuthology.orchestra.run.trial185.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 74 MB/s | 30 MB 00:00 2026-02-12T22:52:48.979 INFO:teuthology.orchestra.run.trial149.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 53 MB/s | 2.8 MB 00:00 2026-02-12T22:52:49.121 INFO:teuthology.orchestra.run.trial149.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 71 MB/s | 30 MB 00:00 2026-02-12T22:52:49.158 INFO:teuthology.orchestra.run.trial185.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 64 MB/s | 41 MB 00:00 2026-02-12T22:52:49.159 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:52:49.160 INFO:teuthology.orchestra.run.trial185.stdout:Total 146 MB/s | 93 MB 00:00 2026-02-12T22:52:49.160 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-12T22:52:49.181 INFO:teuthology.orchestra.run.trial149.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 77 MB/s | 41 MB 00:00 2026-02-12T22:52:49.182 INFO:teuthology.orchestra.run.trial149.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:52:49.190 INFO:teuthology.orchestra.run.trial149.stdout:Total 175 MB/s | 93 MB 00:00 2026-02-12T22:52:49.190 INFO:teuthology.orchestra.run.trial149.stdout:Running transaction check 2026-02-12T22:52:49.305 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-12T22:52:49.305 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-12T22:52:49.329 INFO:teuthology.orchestra.run.trial149.stdout:Transaction check succeeded. 2026-02-12T22:52:49.329 INFO:teuthology.orchestra.run.trial149.stdout:Running transaction test 2026-02-12T22:52:49.706 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-12T22:52:49.706 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-12T22:52:49.731 INFO:teuthology.orchestra.run.trial149.stdout:Transaction test succeeded. 2026-02-12T22:52:49.731 INFO:teuthology.orchestra.run.trial149.stdout:Running transaction 2026-02-12T22:52:50.400 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-12T22:52:50.423 INFO:teuthology.orchestra.run.trial149.stdout: Preparing : 1/1 2026-02-12T22:52:50.602 INFO:teuthology.orchestra.run.trial185.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:52:50.624 INFO:teuthology.orchestra.run.trial185.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:52:50.627 INFO:teuthology.orchestra.run.trial149.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:52:50.648 INFO:teuthology.orchestra.run.trial149.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:52:51.874 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:52:51.902 INFO:teuthology.orchestra.run.trial185.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:52:51.906 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:52:51.934 INFO:teuthology.orchestra.run.trial149.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:52:53.745 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:52:53.750 INFO:teuthology.orchestra.run.trial185.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:52:53.776 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:52:53.782 INFO:teuthology.orchestra.run.trial149.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:52:55.611 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:52:55.620 INFO:teuthology.orchestra.run.trial185.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:52:55.643 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:52:55.653 INFO:teuthology.orchestra.run.trial149.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:52:57.484 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:52:57.519 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.098 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.121 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.201 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.225 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.351 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.351 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-12T22:53:31.352 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-12T22:53:31.415 DEBUG:teuthology.orchestra.run.trial185:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:53:31.441 INFO:teuthology.orchestra.run.trial149.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:31.441 INFO:teuthology.orchestra.run.trial149.stdout: 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout:Installed: 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout: 2026-02-12T22:53:31.442 INFO:teuthology.orchestra.run.trial149.stdout:Complete! 2026-02-12T22:53:31.449 INFO:teuthology.orchestra.run.trial185.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.450 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.450 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.450 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:53:31.450 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:53:31.451 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2026-02-12T22:53:31.451 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial185.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:53:31.451 DEBUG:teuthology.orchestra.run.trial185:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:53:31.505 DEBUG:teuthology.orchestra.run.trial149:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:53:31.523 INFO:teuthology.orchestra.run.trial185.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.524 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.524 DEBUG:teuthology.orchestra.run.trial185:> sudo rpm -qi grub2-tools 2026-02-12T22:53:31.538 INFO:teuthology.orchestra.run.trial149.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.539 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.540 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.540 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:53:31.540 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:53:31.540 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-12T22:53:31.540 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial149.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:53:31.540 DEBUG:teuthology.orchestra.run.trial149:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:53:31.595 INFO:teuthology.orchestra.run.trial185.stdout:Name : grub2-tools 2026-02-12T22:53:31.595 INFO:teuthology.orchestra.run.trial185.stdout:Epoch : 1 2026-02-12T22:53:31.595 INFO:teuthology.orchestra.run.trial185.stdout:Version : 2.12 2026-02-12T22:53:31.595 INFO:teuthology.orchestra.run.trial185.stdout:Release : 29.el10_1 2026-02-12T22:53:31.595 INFO:teuthology.orchestra.run.trial185.stdout:Architecture: x86_64 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Group : Unspecified 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Size : 7963769 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:License : GPL-3.0-or-later 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Signature : 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Packager : Release Engineering 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:53:31.596 INFO:teuthology.orchestra.run.trial185.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:Summary : Support tools for GRUB. 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:Description : 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:hardware devices. 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-12T22:53:31.597 INFO:teuthology.orchestra.run.trial185.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:53:31.598 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:53:31.598 INFO:teuthology.task.kernel:Updating grub on trial185 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.599 DEBUG:teuthology.orchestra.run.trial185:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:53:31.612 INFO:teuthology.orchestra.run.trial149.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.613 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.614 DEBUG:teuthology.orchestra.run.trial149:> sudo rpm -qi grub2-tools 2026-02-12T22:53:31.664 INFO:teuthology.orchestra.run.trial185.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:53:31.666 DEBUG:teuthology.orchestra.run.trial185:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:53:31.685 INFO:teuthology.orchestra.run.trial149.stdout:Name : grub2-tools 2026-02-12T22:53:31.685 INFO:teuthology.orchestra.run.trial149.stdout:Epoch : 1 2026-02-12T22:53:31.685 INFO:teuthology.orchestra.run.trial149.stdout:Version : 2.12 2026-02-12T22:53:31.685 INFO:teuthology.orchestra.run.trial149.stdout:Release : 29.el10_1 2026-02-12T22:53:31.685 INFO:teuthology.orchestra.run.trial149.stdout:Architecture: x86_64 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Group : Unspecified 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Size : 7963769 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:License : GPL-3.0-or-later 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Signature : 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Packager : Release Engineering 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:53:31.686 INFO:teuthology.orchestra.run.trial149.stdout:Summary : Support tools for GRUB. 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout:Description : 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout: 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout:hardware devices. 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout: 2026-02-12T22:53:31.687 INFO:teuthology.orchestra.run.trial149.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:53:31.688 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:53:31.688 INFO:teuthology.task.kernel:Updating grub on trial149 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.689 DEBUG:teuthology.orchestra.run.trial149:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:53:31.730 INFO:teuthology.orchestra.run.trial185.stdout:/sbin/grubby 2026-02-12T22:53:31.732 INFO:teuthology.orchestra.run.trial185.stdout:yes 2026-02-12T22:53:31.732 DEBUG:teuthology.orchestra.run.trial185:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:53:31.754 INFO:teuthology.orchestra.run.trial149.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:53:31.756 DEBUG:teuthology.orchestra.run.trial149:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:53:31.798 INFO:teuthology.orchestra.run.trial185.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:53:31.799 DEBUG:teuthology.orchestra.run.trial185:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.822 INFO:teuthology.orchestra.run.trial149.stdout:/sbin/grubby 2026-02-12T22:53:31.823 INFO:teuthology.orchestra.run.trial149.stdout:yes 2026-02-12T22:53:31.824 DEBUG:teuthology.orchestra.run.trial149:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:53:31.875 DEBUG:teuthology.orchestra.run.trial185:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:53:31.890 INFO:teuthology.orchestra.run.trial149.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:53:31.891 DEBUG:teuthology.orchestra.run.trial149:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.968 DEBUG:teuthology.orchestra.run.trial149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:53:31.985 INFO:teuthology.orchestra.run.trial185.stderr:Generating grub configuration file ... 2026-02-12T22:53:32.078 INFO:teuthology.orchestra.run.trial149.stderr:Generating grub configuration file ... 2026-02-12T22:53:32.160 INFO:teuthology.orchestra.run.trial185.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:53:32.169 INFO:teuthology.orchestra.run.trial185.stderr:done 2026-02-12T22:53:32.171 DEBUG:teuthology.orchestra.run.trial185:> test -d /sys/firmware/efi 2026-02-12T22:53:32.189 DEBUG:teuthology.orchestra.run.trial185:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:53:32.254 INFO:teuthology.orchestra.run.trial149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:53:32.262 INFO:teuthology.orchestra.run.trial185.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:53:32.262 INFO:teuthology.orchestra.run.trial185.stdout:/boot/efi/EFI/rocky 2026-02-12T22:53:32.263 INFO:teuthology.orchestra.run.trial149.stderr:done 2026-02-12T22:53:32.264 DEBUG:teuthology.orchestra.run.trial185:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:53:32.265 DEBUG:teuthology.orchestra.run.trial149:> test -d /sys/firmware/efi 2026-02-12T22:53:32.282 DEBUG:teuthology.orchestra.run.trial149:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:53:32.331 INFO:teuthology.orchestra.run.trial185.stdout:no 2026-02-12T22:53:32.332 DEBUG:teuthology.orchestra.run.trial185:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:53:32.351 INFO:teuthology.orchestra.run.trial149.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:53:32.352 INFO:teuthology.orchestra.run.trial149.stdout:/boot/efi/EFI/rocky 2026-02-12T22:53:32.353 DEBUG:teuthology.orchestra.run.trial149:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:53:32.397 INFO:teuthology.orchestra.run.trial185.stdout:yes 2026-02-12T22:53:32.398 DEBUG:teuthology.orchestra.run.trial185:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:53:32.421 INFO:teuthology.orchestra.run.trial149.stdout:no 2026-02-12T22:53:32.422 DEBUG:teuthology.orchestra.run.trial149:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:53:32.464 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial185 2026-02-12T22:53:32.464 DEBUG:teuthology.orchestra.run.trial185:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:53:32.487 INFO:teuthology.orchestra.run.trial149.stdout:yes 2026-02-12T22:53:32.488 DEBUG:teuthology.orchestra.run.trial149:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:53:32.529 INFO:teuthology.orchestra.run.trial185.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:53:32.557 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial149 2026-02-12T22:53:32.557 DEBUG:teuthology.orchestra.run.trial149:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:53:32.622 INFO:teuthology.orchestra.run.trial149.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:54:02.507 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:02.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:02.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:02.607 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:02.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:02.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:02.661 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:02.672 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:02.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:02.679 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:02.679 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:02.736 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:02.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:02.760 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:02.761 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:02.818 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.738 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:03.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:03.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.836 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:03.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:03.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.889 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:03.900 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:03.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:03.948 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.948 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:03.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:03.975 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.975 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:04.005 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.033 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.006 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:05.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:05.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.092 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:05.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:05.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.144 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:05.155 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:05.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:05.202 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.202 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:05.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:05.229 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.229 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:05.259 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.287 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.260 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:06.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:06.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.359 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:06.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:06.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.411 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:06.422 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:06.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:06.469 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.470 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:06.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:06.501 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.501 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:06.526 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.558 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.528 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:07.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:07.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.627 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:07.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:07.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.679 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:07.690 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:07.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:07.738 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:07.738 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:07.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:07.763 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:07.763 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:07.795 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:07.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:07.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:07.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.820 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:07.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:07.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:07.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.797 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:08.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:08.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.895 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:08.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:08.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.948 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:08.958 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:09.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:09.006 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.006 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:09.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:09.037 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.037 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:09.063 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:09.093 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.064 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:10.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:10.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.164 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:10.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:10.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.215 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:10.226 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:10.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:10.275 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.276 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:10.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:10.308 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.308 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:10.332 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.365 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.334 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:11.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:11.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.400 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:11.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:11.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.452 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:11.463 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:11.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:11.511 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.511 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:11.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:11.551 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.551 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:11.568 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.608 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.609 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.609 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:12.569 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:12.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:12.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.667 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:12.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:12.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.719 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:12.730 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:12.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:12.778 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:12.778 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:12.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:12.819 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:12.819 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:12.836 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:12.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:12.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:12.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:12.876 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:12.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:12.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:12.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:13.837 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:13.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:13.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:13.935 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:13.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:13.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:13.987 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:13.997 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:14.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:14.044 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.044 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:14.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:14.077 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.078 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:14.101 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:14.135 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.102 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:15.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:15.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.202 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:15.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:15.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.254 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:15.265 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:15.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:15.313 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.313 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:15.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:15.342 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.342 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:15.370 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.371 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.398 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.371 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:16.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:16.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.470 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:16.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:16.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.522 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:16.533 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:16.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:16.580 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.580 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:16.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:16.608 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.608 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:16.637 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.665 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.637 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:17.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:17.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.693 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:17.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:17.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.745 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:17.755 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:17.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:17.802 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.802 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:17.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:17.841 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.841 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:17.858 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:17.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:17.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:17.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.898 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:17.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:17.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:17.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:18.860 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:18.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:18.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:18.959 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:18.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:18.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:19.011 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:19.022 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:19.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:19.071 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.071 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:19.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:19.110 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.111 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:19.128 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:19.168 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.130 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:20.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:20.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:20.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:20.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.284 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:20.296 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:20.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:20.303 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.303 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:20.360 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:20.369 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.370 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:20.426 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.361 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:21.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:21.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:21.456 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:21.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:21.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:21.508 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:21.519 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:21.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:21.567 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.567 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:21.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:21.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.607 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:21.624 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.664 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.625 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:22.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:22.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.676 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:22.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:22.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.752 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:22.764 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:22.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:22.771 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.771 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:22.828 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:22.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:22.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:22.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:22.844 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.844 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:22.902 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:22.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:22.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:22.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:23.829 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:23.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:23.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:23.916 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:23.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:23.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:23.968 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:23.979 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:24.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:24.025 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.025 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:24.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:24.056 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.056 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:24.083 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:24.113 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.085 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:25.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:25.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.181 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:25.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:25.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.233 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:25.243 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:25.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:25.293 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.293 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:25.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:25.325 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.325 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:25.349 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.350 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.383 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.350 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:26.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:26.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:26.397 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:26.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:26.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:26.527 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:26.530 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:26.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:26.604 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.605 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:26.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:26.607 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.608 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:26.662 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.664 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.664 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:27.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:27.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.667 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:27.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:27.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.805 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:27.816 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:27.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:27.863 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.863 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:27.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:27.904 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.904 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:27.922 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.961 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:28.923 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:28.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:28.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.974 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:28.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:28.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:29.025 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:29.036 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:29.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:29.083 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.084 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:29.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:29.114 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.114 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:29.140 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:29.171 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.141 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:30.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:30.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.239 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:30.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:30.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.290 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:30.301 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:30.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:30.349 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.349 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:30.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:30.388 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.388 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:30.406 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.445 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.407 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:31.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:31.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:31.506 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:31.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:31.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:31.558 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:31.568 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:31.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:31.616 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:31.616 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:31.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:31.651 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:31.651 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:31.673 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:31.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:31.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:31.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.708 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:31.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:31.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:31.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:32.674 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:32.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:32.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.773 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:32.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:32.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.825 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:32.836 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:32.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:32.884 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.884 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:32.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:32.911 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.911 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:32.941 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:32.969 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:33.944 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:33.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:33.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:34.041 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:34.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:34.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:34.094 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:34.104 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:34.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:34.153 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.153 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:34.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:34.186 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.186 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:34.209 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:34.245 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.210 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:35.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:35.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.308 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:35.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:35.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.360 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:35.371 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:35.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:35.416 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.416 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:35.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:35.449 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.449 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:35.473 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.507 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.474 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:36.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:36.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:36.572 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:36.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:36.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:36.624 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:36.635 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:36.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:36.684 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:36.684 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:36.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:36.711 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:36.711 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:36.740 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:36.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:36.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:36.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.768 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:36.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:36.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:36.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:37.742 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:37.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:37.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.840 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:37.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:37.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.892 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:37.903 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:37.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:37.951 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.951 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:37.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:37.983 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.983 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:38.008 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:38.008 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:38.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:38.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:38.040 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:38.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:38.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:38.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.009 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:39.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:39.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:39.107 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:39.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:39.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:39.159 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:39.170 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:39.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:39.219 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:39.219 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:39.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:39.242 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:39.242 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:39.275 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:39.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:39.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:39.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.300 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:39.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:39.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:39.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:40.277 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:40.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:40.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:40.376 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:40.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:40.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:40.428 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:40.439 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:40.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:40.488 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:40.488 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:40.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:40.515 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:40.515 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:40.545 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:40.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:40.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:40.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:40.571 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:40.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:40.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:40.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:41.546 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:41.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:41.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:41.605 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:41.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:41.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:41.656 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:41.667 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:41.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:41.714 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:41.714 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:41.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:41.740 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:41.741 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:41.771 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:41.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:41.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:41.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:41.798 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:41.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:41.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:41.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:42.773 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:42.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:42.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:42.826 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:42.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:42.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:42.878 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:42.889 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:42.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:42.937 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:42.937 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:42.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:42.963 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:42.963 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:42.994 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:42.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:42.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:42.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:43.020 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:43.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:43.020 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:43.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:43.995 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:43.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:43.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:44.076 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:44.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:44.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:44.128 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:44.138 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:44.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:44.185 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:44.185 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:44.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:44.214 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:44.214 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:44.241 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:44.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:44.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:44.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:44.271 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:44.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:44.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:44.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:45.243 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:45.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:45.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:45.340 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:45.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:45.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:45.392 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:45.403 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:45.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:45.450 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:45.450 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:45.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:45.487 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:45.487 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:45.506 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:45.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:45.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:45.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:45.544 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:45.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:45.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:45.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:46.507 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:46.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:46.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:46.605 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:46.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:46.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:46.657 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:46.668 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:46.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:46.715 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:46.715 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:46.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:46.754 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:46.754 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:46.772 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:46.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:46.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:46.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:46.810 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:46.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:46.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:46.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:47.773 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:47.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:47.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:47.872 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:47.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:47.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:47.924 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:47.934 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:47.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:47.983 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:47.983 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:48.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:48.013 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:48.013 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:48.038 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:48.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:48.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:48.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:48.069 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:48.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:48.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:48.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:49.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:49.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:49.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:49.138 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:49.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:49.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:49.198 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:49.210 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:49.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:49.217 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:49.217 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:49.274 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:49.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:49.274 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:49.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:49.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:49.283 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:49.283 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:49.340 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:49.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:49.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:49.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.274 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:50.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:50.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.373 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:50.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:50.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.454 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:50.466 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:50.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:50.474 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.474 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:50.531 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:50.542 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.543 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:50.600 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.532 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:51.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:51.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.601 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:51.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:51.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.610 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:51.674 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:51.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:51.685 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.685 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:51.742 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:51.750 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.750 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:51.806 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.743 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:52.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:52.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.807 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:52.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:52.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.859 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:52.870 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:52.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:52.876 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:52.877 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:52.933 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:52.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:52.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:52.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:52.946 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:52.946 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:53.003 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:53.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:53.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:53.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:53.934 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:53.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:53.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:54.005 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:54.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:54.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:54.014 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:54.067 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:54.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:54.096 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:54.096 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:54.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:54.143 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:54.143 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:54.153 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:54.153 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:54.153 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:54.153 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:54.200 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:54.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:54.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:54.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.154 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:55.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:55.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.213 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:55.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:55.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.264 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:55.275 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:55.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:55.323 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.323 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:55.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:55.351 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.352 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:55.380 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.408 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.381 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:56.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:56.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.479 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:56.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:56.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.531 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:56.541 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:56.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:56.589 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.590 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:56.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:56.623 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.623 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:56.646 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.681 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:57.647 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:57.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:57.746 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:57.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:57.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:57.798 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:57.809 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:57.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:57.855 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:57.855 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:57.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:57.893 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:57.893 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:57.911 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:57.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:57.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:57.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:57.950 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:57.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:57.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:57.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:58.913 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:54:58.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:58.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:59.010 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:54:59.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:59.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:59.062 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:54:59.073 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:54:59.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:54:59.121 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:59.122 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:54:59.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:54:59.149 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:59.149 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:54:59.178 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:59.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:59.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:59.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:59.206 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:59.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:59.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:59.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.179 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:00.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:00.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.278 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:00.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:00.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.362 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:00.373 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:00.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:00.382 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.382 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:00.438 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:00.457 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.457 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:00.514 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.514 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.514 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.439 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:01.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:01.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.549 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:01.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:01.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.614 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:01.624 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:01.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:01.631 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.631 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:01.688 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:01.701 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.701 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:01.759 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:02.689 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:02.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:02.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.787 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:02.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:02.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.847 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:02.858 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:02.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:02.865 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:02.865 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:02.922 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:02.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:02.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:02.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:02.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:02.941 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:02.941 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:02.997 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:02.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:02.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:02.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:03.923 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:03.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:03.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:03.993 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:03.998 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:03.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:03.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:04.064 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:04.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:04.071 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.071 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:04.129 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:04.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:04.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:04.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:04.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:04.147 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.147 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:04.204 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:04.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:04.205 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:04.205 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.130 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:05.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:05.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:05.229 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:05.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:05.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:05.281 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:05.292 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:05.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:05.340 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.340 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:05.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:05.364 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.364 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:05.397 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.421 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.399 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:06.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:06.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.497 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:06.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:06.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.549 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:06.560 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:06.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:06.608 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.608 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:06.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:06.640 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.640 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:06.665 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.697 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:07.666 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:07.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:07.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:07.765 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:07.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:07.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:07.818 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:07.828 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:07.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:07.878 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:07.878 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:07.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:07.914 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:07.914 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:07.935 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:07.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:07.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:07.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:07.972 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:07.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:07.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:07.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:08.936 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:08.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:08.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.024 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:09.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:09.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.075 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:09.086 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:09.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:09.134 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.134 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:09.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:09.157 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.157 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:09.190 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:09.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:09.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:09.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:09.214 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:09.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:09.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:09.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.192 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:10.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:10.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:10.280 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:10.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:10.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:10.330 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:10.341 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:10.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:10.389 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.389 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:10.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:10.417 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.417 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:10.446 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.447 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.473 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.448 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:11.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:11.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.546 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:11.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:11.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.598 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:11.608 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:11.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:11.657 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:11.657 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:11.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:11.693 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:11.693 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:11.714 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:11.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:11.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:11.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.751 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:11.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:11.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:11.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:12.716 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:12.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:12.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:12.814 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:12.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:12.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:12.866 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:12.877 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:12.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:12.926 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.926 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:12.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:12.954 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.954 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:12.983 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.012 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:13.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:13.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:13.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.985 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:13.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:13.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.082 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:14.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:14.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.134 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:14.145 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:14.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:14.195 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.195 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:14.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:14.230 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.230 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:14.251 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:14.288 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.253 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:15.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:15.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:15.353 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:15.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:15.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:15.405 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:15.415 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:15.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:15.463 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:15.463 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:15.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:15.497 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:15.498 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:15.520 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.555 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:16.521 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:16.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:16.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.620 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:16.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:16.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.672 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:16.683 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:16.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:16.730 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:16.731 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:16.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:16.762 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:16.762 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:16.787 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:16.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:16.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:16.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:16.820 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:16.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:16.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:16.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:17.788 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:17.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:17.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:17.839 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:17.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:17.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:17.890 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:17.901 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:17.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:17.947 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.947 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:17.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:17.977 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.978 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:18.004 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.034 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.005 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:19.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:19.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.100 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:19.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:19.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.152 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:19.163 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:19.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:19.210 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.210 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:19.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:19.238 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.238 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:19.267 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.295 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.268 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:20.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:20.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:20.397 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:20.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:20.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:20.451 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:20.462 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:20.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:20.468 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:20.468 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:20.525 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:20.545 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:20.545 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:20.601 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:21.526 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:21.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:21.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.624 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:21.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:21.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.676 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:21.687 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:21.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:21.735 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:21.736 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:21.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:21.766 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:21.766 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:21.792 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:21.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:21.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:21.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:21.824 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:21.824 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:21.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:21.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:22.794 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:22.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:22.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:22.893 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:22.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:22.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:22.945 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:22.956 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:23.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:23.004 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.004 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:23.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:23.034 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.034 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:23.061 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.061 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.061 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.091 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.062 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:24.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:24.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.163 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:24.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:24.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.215 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:24.226 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:24.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:24.275 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.275 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:24.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:24.297 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.297 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:24.332 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.354 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.334 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:25.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:25.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:25.432 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:25.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:25.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:25.485 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:25.496 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:25.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:25.545 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:25.545 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:25.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:25.576 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:25.576 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:25.602 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.633 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:26.602 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:26.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:26.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.692 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:26.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:26.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.744 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:26.754 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:26.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:26.803 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:26.803 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:26.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:26.837 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:26.837 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:26.860 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:26.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:26.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:26.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:26.894 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:26.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:26.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:26.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:27.861 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:27.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:27.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:27.961 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:27.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:27.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.012 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:28.023 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:28.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:28.072 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.072 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:28.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:28.106 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.107 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:28.129 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.164 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.130 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:29.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:29.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.230 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:29.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:29.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.282 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:29.292 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:29.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:29.340 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.340 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:29.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:29.370 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.370 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:29.397 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.428 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.398 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:30.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:30.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.497 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:30.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:30.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.548 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:30.559 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:30.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:30.608 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:30.608 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:30.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:30.635 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:30.635 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:30.665 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:30.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:30.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:30.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.692 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:30.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:30.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:30.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:31.666 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:31.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:31.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:31.765 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:31.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:31.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:31.818 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:31.828 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:31.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:31.877 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:31.877 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:31.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:31.916 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:31.916 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:31.933 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:31.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:31.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:31.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:31.974 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:31.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:31.974 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:31.975 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:32.934 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:32.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:32.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.033 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:33.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:33.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.085 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:33.096 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:33.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:33.145 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.145 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:33.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:33.169 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.170 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:33.202 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.227 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.204 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:34.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:34.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.303 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:34.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:34.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.356 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:34.366 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:34.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:34.415 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.415 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:34.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:34.448 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.448 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:34.472 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.505 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.474 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:35.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:35.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.572 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:35.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:35.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.624 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:35.635 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:35.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:35.683 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:35.683 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:35.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:35.712 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:35.712 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:35.740 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:35.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:35.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:35.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.769 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:35.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:35.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:35.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:36.740 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:36.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:36.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:36.850 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:36.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:36.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:36.901 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:36.912 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:36.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:36.959 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:36.959 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:37.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:37.000 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.000 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:37.016 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:37.057 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.018 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:38.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:38.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.119 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:38.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:38.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.171 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:38.182 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:38.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:38.229 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.230 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:38.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:38.269 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.269 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:38.286 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.327 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.287 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:39.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:39.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.386 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:39.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:39.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.438 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:39.448 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:39.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:39.497 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.497 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:39.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:39.523 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.523 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:39.554 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.581 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.557 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:40.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:40.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.656 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:40.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:40.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.708 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:40.719 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:40.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:40.767 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:40.767 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:40.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:40.797 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:40.798 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:40.824 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:40.824 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:40.824 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:40.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.855 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:40.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:40.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:40.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:41.826 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:41.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:41.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:41.925 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:41.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:41.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:41.977 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:41.988 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:42.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:42.036 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.036 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:42.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:42.063 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.063 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:42.092 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:42.120 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.094 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:43.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:43.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.192 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:43.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:43.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.245 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:43.255 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:43.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:43.303 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.303 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:43.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:43.341 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.341 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:43.360 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.398 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.361 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:44.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:44.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.458 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:44.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:44.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.514 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:44.525 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:44.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:44.573 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.573 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:44.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:44.609 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.609 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:44.630 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.667 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:45.631 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:45.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:45.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.730 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:45.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:45.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.783 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:45.793 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:45.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:45.841 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:45.842 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:45.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:45.871 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:45.871 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:45.898 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:45.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:45.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:45.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:45.928 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:45.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:45.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:45.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:46.900 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:46.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:46.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:46.998 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:46.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:46.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.050 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:47.060 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:47.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:47.110 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.110 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:47.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:47.146 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.146 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:47.167 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.203 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.168 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:48.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:48.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.267 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:48.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:48.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.318 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:48.329 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:48.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:48.378 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.379 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:48.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:48.404 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.404 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:48.436 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.460 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.436 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:49.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:49.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.538 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:49.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:49.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.590 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:49.601 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:49.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:49.649 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.649 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:49.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:49.675 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.675 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:49.707 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.731 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.731 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:50.708 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:50.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:50.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.806 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:50.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:50.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.859 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:50.869 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:50.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:50.916 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:50.916 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:50.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:50.948 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:50.948 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:50.973 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:50.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:50.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:50.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.005 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:51.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:51.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:51.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.974 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:51.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:51.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.073 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:52.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:52.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.126 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:52.136 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:52.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:52.185 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.185 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:52.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:52.220 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.220 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:52.242 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.278 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.243 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:53.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:53.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.341 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:53.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:53.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.393 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:53.404 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:53.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:53.453 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.453 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:53.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:53.492 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.492 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:53.509 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.550 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.510 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:54.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:54.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.609 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:54.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:54.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.669 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:54.681 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:54.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:54.688 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.688 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:54.744 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:54.756 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.756 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:54.812 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.813 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:55.745 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:55.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:55.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.844 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:55.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:55.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.896 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:55.907 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:55.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:55.955 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:55.955 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:55.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:55.995 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:55.995 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:56.011 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:56.052 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.052 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.052 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.052 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.012 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:57.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:57.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.111 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:57.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:57.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.174 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:57.186 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:57.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:57.192 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.192 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:57.249 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:57.257 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.257 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:57.313 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.250 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:58.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.365 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:58.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:58.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.430 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:58.441 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:58.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:58.447 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.447 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:58.505 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:58.516 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.516 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:58.573 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.506 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:55:59.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:59.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.632 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:55:59.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:59.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.687 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:55:59.698 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:55:59.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:55:59.705 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:59.705 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:55:59.762 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:59.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:59.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:59.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:55:59.789 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:59.789 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:55:59.846 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:59.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:59.846 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:59.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:00.763 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:00.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:00.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:00.872 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:00.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:00.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:00.923 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:00.934 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:00.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:00.982 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:00.982 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:01.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:01.017 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:01.017 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:01.038 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:01.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:01.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:01.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:01.074 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:01.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:01.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:01.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:02.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:02.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.138 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:02.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:02.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.191 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:02.202 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:02.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:02.249 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:02.250 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:02.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:02.286 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:02.286 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:02.306 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:02.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:02.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:02.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.344 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:02.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:02.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:02.344 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.308 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:03.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:03.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.407 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:03.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:03.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.460 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:03.470 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:03.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:03.518 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:03.518 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:03.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:03.547 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:03.547 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:03.576 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:03.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:03.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:03.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.603 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:03.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:03.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:03.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.577 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:04.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:04.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.676 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:04.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:04.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.728 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:04.739 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:04.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:04.787 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:04.787 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:04.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:04.817 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:04.817 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:04.843 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:04.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:04.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:04.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.873 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:04.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:04.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:04.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:05.845 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:05.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:05.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.943 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:05.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:05.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.996 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:06.006 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:06.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:06.054 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:06.054 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:06.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:06.087 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:06.087 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:06.110 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:06.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:06.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:06.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:06.144 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:06.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:06.144 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:06.144 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.112 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:07.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:07.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.172 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:07.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:07.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.223 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:07.234 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:07.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:07.282 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:07.282 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:07.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:07.310 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:07.310 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:07.338 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:07.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:07.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:07.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.367 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:07.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:07.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:07.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.340 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:08.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:08.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.438 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:08.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:08.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.493 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:08.504 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:08.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:08.510 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:08.511 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:08.567 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:08.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:08.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:08.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:08.588 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:08.588 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:08.645 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:08.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:08.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:08.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.569 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:09.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:09.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:09.668 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:09.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:09.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:09.719 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:09.730 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:09.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:09.778 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:09.778 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:09.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:09.804 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:09.804 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:09.836 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:09.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:09.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:09.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.861 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:09.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:09.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:09.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:10.837 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:10.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:10.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.936 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:10.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:10.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.988 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:10.999 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:11.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:11.047 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:11.047 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:11.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:11.076 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:11.076 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:11.105 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:11.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:11.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:11.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:11.133 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:11.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:11.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:11.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.107 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:12.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:12.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.196 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:12.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:12.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.249 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:12.260 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:12.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:12.308 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:12.308 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:12.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:12.344 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:12.344 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:12.364 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:12.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:12.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:12.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.401 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:12.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:12.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:12.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.366 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:13.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:13.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.464 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:13.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:13.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.516 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:13.527 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:13.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:13.574 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:13.574 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:13.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:13.603 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:13.603 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:13.631 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:13.631 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:13.632 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:13.632 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.661 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:13.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:13.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:13.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.633 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:14.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:14.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:14.732 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:14.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:14.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:14.783 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:14.794 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:14.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:14.843 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:14.843 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:14.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:14.873 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:14.874 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:14.899 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:14.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:14.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:14.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.931 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:14.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:14.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:14.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:15.901 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:15.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:15.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.992 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:15.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:15.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:16.043 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:16.054 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:16.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:16.103 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:16.103 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:16.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:16.137 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:16.137 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:16.161 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:16.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:16.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:16.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:16.194 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:16.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:16.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:16.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.163 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:17.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:17.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.261 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:17.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:17.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.327 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:17.336 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:17.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:17.344 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:17.344 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:17.401 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:17.401 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:17.401 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:17.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:17.410 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:17.410 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:17.467 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:17.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:17.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:17.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.401 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:18.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:18.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.500 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:18.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:18.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.551 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:18.561 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:18.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:18.610 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:18.610 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:18.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:18.639 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:18.639 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:18.666 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:18.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:18.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:18.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.696 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:18.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:18.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:18.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.668 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:19.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:19.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:19.764 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:19.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:19.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:19.816 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:19.827 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:19.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:19.874 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:19.874 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:19.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:19.912 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:19.913 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:19.930 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:19.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:19.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:19.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.969 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:19.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:19.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:19.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:20.932 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:20.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:20.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:21.032 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:21.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:21.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:21.085 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:21.096 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:21.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:21.144 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:21.144 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:21.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:21.176 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:21.176 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:21.200 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:21.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:21.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:21.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.232 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:21.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:21.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:21.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.202 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:22.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:22.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.301 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:22.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:22.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.353 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:22.363 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:22.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:22.412 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:22.412 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:22.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:22.446 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:22.446 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:22.469 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:22.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:22.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:22.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.503 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:22.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:22.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:22.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.470 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:23.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:23.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.568 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:23.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:23.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.621 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:23.631 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:23.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:23.679 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:23.679 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:23.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:23.712 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:23.712 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:23.737 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:23.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:23.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:23.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.769 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:23.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:23.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:23.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.739 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:24.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:24.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.840 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:24.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:24.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.891 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:24.902 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:24.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:24.951 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:24.951 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:24.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:24.978 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:24.978 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:25.007 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:25.008 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:25.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:25.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:25.035 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:25.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:25.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:25.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.008 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:26.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:26.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.110 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:26.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:26.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.163 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:26.174 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:26.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:26.222 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:26.223 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:26.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:26.258 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:26.258 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:26.279 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:26.280 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:26.280 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:26.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.315 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:26.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:26.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:26.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.281 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:27.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:27.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.380 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:27.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:27.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.433 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:27.443 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:27.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:27.491 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:27.491 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:27.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:27.520 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:27.520 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:27.548 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:27.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:27.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:27.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.577 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:27.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:27.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:27.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.550 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:28.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:28.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.648 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:28.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:28.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.701 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:28.711 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:28.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:28.760 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:28.760 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:28.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:28.787 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:28.787 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:28.817 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:28.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:28.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:28.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.844 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:28.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:28.844 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:28.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.819 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:29.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:29.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.876 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:29.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:29.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.927 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:29.938 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:29.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:29.987 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:29.987 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:30.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:30.015 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:30.015 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:30.043 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:30.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:30.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:30.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:30.072 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:30.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:30.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:30.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.045 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:31.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:31.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.143 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:31.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:31.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.195 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:31.205 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:31.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:31.253 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:31.253 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:31.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:31.281 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:31.281 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:31.310 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:31.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:31.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:31.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.337 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:31.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:31.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:31.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.310 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:32.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:32.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.409 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:32.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:32.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.462 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:32.473 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:32.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:32.521 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:32.521 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:32.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:32.560 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:32.560 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:32.578 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:32.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:32.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:32.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.617 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:32.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:32.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:32.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.580 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:33.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:33.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.679 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:33.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:33.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.733 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:33.743 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:33.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:33.791 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:33.791 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:33.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:33.816 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:33.816 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:33.848 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:33.848 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:33.848 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:33.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.873 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:33.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:33.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:33.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.849 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:34.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:34.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.947 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:34.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:34.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.999 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:35.009 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:35.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:35.057 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:35.057 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:35.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:35.083 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:35.084 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:35.115 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:35.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:35.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:35.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.141 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:35.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:35.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:35.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.116 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:36.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:36.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.214 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:36.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:36.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.266 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:36.277 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:36.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:36.322 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:36.322 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:36.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:36.352 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:36.352 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:36.379 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:36.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:36.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:36.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.409 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:36.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:36.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:36.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:37.380 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:37.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:37.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.479 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:37.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:37.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.532 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:37.543 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:37.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:37.591 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:37.591 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:37.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:37.630 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:37.630 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:37.649 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:37.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:37.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:37.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:37.687 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:37.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:37.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:37.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.650 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:38.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:38.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.749 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:38.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:38.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.801 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:38.812 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:38.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:38.859 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:38.859 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:38.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:38.894 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:38.894 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:38.916 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:38.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:38.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:38.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.951 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:38.952 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:38.952 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:38.952 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.918 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:39.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:39.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.018 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:40.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:40.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.071 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:40.081 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:40.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:40.130 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:40.130 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:40.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:40.156 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:40.156 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:40.188 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:40.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:40.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:40.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.212 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:40.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:40.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:40.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.189 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:41.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:41.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.300 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:41.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:41.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.352 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:41.363 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:41.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:41.410 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:41.410 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:41.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:41.445 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:41.445 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:41.467 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:41.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:41.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:41.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.501 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:41.501 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:41.501 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:41.501 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:42.469 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:42.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:42.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.568 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:42.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:42.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.620 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:42.631 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:42.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:42.677 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:42.677 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:42.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:42.711 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:42.712 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:42.734 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:42.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:42.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:42.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:42.769 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:42.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:42.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:42.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:43.735 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:43.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:43.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:43.834 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:43.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:43.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:43.886 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:43.897 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:43.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:43.945 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:43.945 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:43.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:43.982 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:43.982 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:44.003 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:44.003 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:44.003 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:44.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.039 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:44.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:44.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:44.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.004 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:45.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:45.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.102 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:45.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:45.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.155 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:45.166 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:45.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:45.213 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:45.213 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:45.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:45.240 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:45.240 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:45.270 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:45.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:45.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:45.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.297 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:45.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:45.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:45.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.271 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:46.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:46.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.368 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:46.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:46.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.421 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:46.431 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:46.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:46.479 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:46.479 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:46.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:46.518 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:46.518 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:46.536 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:46.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:46.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:46.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.575 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:46.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:46.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:46.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:47.538 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:47.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:47.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.637 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:47.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:47.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.689 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:47.700 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:47.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:47.748 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:47.749 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:47.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:47.775 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:47.776 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:47.805 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:47.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:47.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:47.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:47.833 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:47.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:47.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:47.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:48.807 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:48.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:48.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.905 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:48.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:48.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.956 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:48.966 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:49.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:49.015 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:49.015 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:49.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:49.045 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:49.045 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:49.073 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:49.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:49.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:49.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.102 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:49.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:49.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:49.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.074 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:50.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:50.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.176 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:50.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:50.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.228 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:50.238 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:50.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:50.286 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:50.286 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:50.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:50.313 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:50.313 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:50.344 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:50.344 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:50.344 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:50.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.370 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:50.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:50.371 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:50.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:51.346 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:51.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:51.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.444 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:51.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:51.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.496 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:51.507 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:51.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:51.555 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:51.555 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:51.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:51.581 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:51.581 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:51.612 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:51.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:51.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:51.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:51.637 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:51.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:51.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:51.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.614 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:52.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:52.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:52.712 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:52.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:52.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:52.764 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:52.775 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:52.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:52.823 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:52.823 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:52.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:52.857 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:52.857 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:52.879 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:52.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:52.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:52.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.915 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:52.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:52.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:52.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:53.880 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:53.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:53.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:53.978 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:53.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:53.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:54.029 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:54.040 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:54.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:54.088 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:54.088 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:54.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:54.130 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:54.130 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:54.146 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:54.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:54.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:54.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:54.187 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:54.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:54.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:54.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.147 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:55.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:55.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:55.246 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:55.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:55.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:55.298 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:55.309 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:55.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:55.358 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:55.358 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:55.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:55.386 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:55.386 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:55.414 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:55.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:55.415 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:55.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.443 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:55.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:55.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:55.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:56.415 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:56.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:56.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.514 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:56.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:56.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.566 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:56.577 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:56.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:56.625 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:56.625 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:56.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:56.652 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:56.652 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:56.682 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:56.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:56.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:56.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:56.709 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:56.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:56.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:56.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:57.684 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:57.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:57.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:57.782 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:57.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:57.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:57.835 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:57.845 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:57.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:57.894 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:57.894 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:57.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:57.928 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:57.928 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:57.951 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:57.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:57.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:57.952 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:57.985 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:57.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:57.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:57.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:58.953 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:56:58.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:58.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.052 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:56:59.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:59.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.104 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:56:59.114 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:56:59.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:56:59.162 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:59.162 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:56:59.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:56:59.189 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:59.189 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:56:59.220 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:59.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:59.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:59.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:59.246 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:59.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:59.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:59.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.222 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:00.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:00.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:00.320 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:00.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:00.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:00.370 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:00.381 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:00.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:00.429 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:00.429 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:00.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:00.468 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:00.468 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:00.487 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:00.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:00.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:00.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.525 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:00.525 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:00.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:00.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:01.489 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:01.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:01.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.588 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:01.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:01.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.640 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:01.651 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:01.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:01.698 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:01.698 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:01.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:01.736 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:01.736 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:01.756 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:01.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:01.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:01.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:01.793 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:01.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:01.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:01.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:02.757 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:02.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:02.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:02.853 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:02.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:02.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:02.904 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:02.914 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:02.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:02.962 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:02.962 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:03.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:03.001 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:03.002 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:03.019 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:03.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:03.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:03.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:03.058 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:03.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:03.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:03.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.020 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:04.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:04.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.119 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:04.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:04.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.171 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:04.182 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:04.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:04.229 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:04.229 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:04.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:04.274 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:04.274 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:04.287 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:04.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:04.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:04.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.331 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:04.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:04.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:04.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.289 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:05.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:05.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:05.386 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:05.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:05.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:05.441 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:05.452 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:05.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:05.498 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:05.498 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:05.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:05.527 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:05.527 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:05.554 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:05.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:05.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:05.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.583 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:05.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:05.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:05.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:06.555 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:06.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:06.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:06.655 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:06.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:06.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:06.707 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:06.717 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:06.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:06.766 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:06.766 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:06.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:06.810 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:06.810 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:06.823 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:06.824 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:06.824 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:06.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:06.868 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:06.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:06.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:06.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:07.825 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:07.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:07.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.923 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:07.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:07.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.975 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:07.986 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:08.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:08.033 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:08.033 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:08.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:08.073 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:08.073 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:08.091 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:08.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:08.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:08.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:08.130 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:08.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:08.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:08.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.092 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:09.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:09.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.191 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:09.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:09.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.242 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:09.252 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:09.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:09.300 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:09.300 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:09.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:09.330 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:09.330 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:09.356 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:09.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:09.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:09.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.387 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:09.387 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:09.387 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:09.387 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:10.357 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:10.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:10.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:10.456 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:10.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:10.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:10.507 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:10.518 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:10.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:10.567 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:10.568 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:10.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:10.589 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:10.590 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:10.626 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:10.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:10.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:10.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:10.647 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:10.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:10.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:10.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:11.627 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:11.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:11.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:11.727 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:11.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:11.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:11.779 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:11.790 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:11.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:11.839 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:11.839 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:11.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:11.882 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:11.882 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:11.896 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:11.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:11.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:11.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:11.939 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:11.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:11.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:11.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:12.898 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:12.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:12.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:12.998 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:12.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:12.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:13.049 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:13.060 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:13.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:13.107 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:13.107 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:13.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:13.138 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:13.138 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:13.165 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:13.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:13.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:13.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:13.195 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:13.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:13.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:13.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.166 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:14.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:14.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.265 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:14.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:14.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.316 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:14.327 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:14.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:14.374 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:14.374 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:14.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:14.405 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:14.405 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:14.431 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:14.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:14.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:14.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.462 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:14.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:14.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:14.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:15.432 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:15.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:15.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:15.528 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:15.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:15.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:15.579 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:15.589 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:15.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:15.635 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:15.635 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:15.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:15.672 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:15.672 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:15.692 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:15.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:15.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:15.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:15.729 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:15.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:15.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:15.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:16.694 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:16.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:16.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:16.793 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:16.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:16.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:16.846 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:16.857 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:16.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:16.906 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:16.906 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:16.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:16.932 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:16.932 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:16.963 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:16.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:16.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:16.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:16.989 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:16.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:16.990 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:16.990 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:17.965 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:17.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:17.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:18.064 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:18.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:18.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:18.116 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:18.127 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:18.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:18.177 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:18.177 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:18.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:18.201 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:18.201 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:18.234 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:18.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:18.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:18.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:18.258 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:18.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:18.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:18.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.235 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:19.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:19.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.334 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:19.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:19.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.386 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:19.397 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:19.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:19.444 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:19.445 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:19.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:19.481 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:19.481 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:19.502 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:19.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:19.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:19.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.538 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:19.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:19.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:19.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:20.503 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:20.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:20.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:20.604 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:20.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:20.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:20.657 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:20.668 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:20.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:20.715 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:20.716 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:20.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:20.750 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:20.750 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:20.773 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:20.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:20.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:20.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:20.807 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:20.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:20.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:20.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:21.775 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:21.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:21.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:21.869 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:21.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:21.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:21.921 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:21.931 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:21.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:21.980 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:21.980 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:22.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:22.022 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:22.022 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:22.039 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:22.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:22.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:22.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:22.079 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:22.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:22.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:22.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:23.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:23.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:23.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:23.140 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:23.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:23.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:23.192 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:23.203 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:23.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:23.251 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:23.251 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:23.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:23.279 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:23.279 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:23.308 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:23.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:23.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:23.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:23.336 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:23.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:23.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:23.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:24.309 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:24.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:24.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.408 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:24.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:24.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.460 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:24.470 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:24.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:24.518 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:24.518 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:24.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:24.548 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:24.548 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:24.576 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:24.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:24.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:24.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:24.605 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:24.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:24.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:24.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:25.577 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:25.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:25.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:25.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:25.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:25.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:25.727 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:25.737 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:25.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:25.785 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:25.785 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:25.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:25.824 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:25.824 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:25.841 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:25.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:25.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:25.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:25.882 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:25.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:25.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:25.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:26.843 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:26.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:26.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:26.943 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:26.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:26.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:26.996 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:27.006 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:27.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:27.055 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:27.055 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:27.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:27.083 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:27.083 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:27.112 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:27.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:27.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:27.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:27.142 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:27.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:27.142 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:27.142 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:28.113 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:28.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:28.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:28.213 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:28.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:28.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:28.266 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:28.277 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:28.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:28.326 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:28.326 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:28.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:28.354 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:28.354 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:28.383 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:28.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:28.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:28.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:28.411 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:28.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:28.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:28.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:29.384 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:29.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:29.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.482 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:29.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:29.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.534 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:29.545 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:29.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:29.592 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:29.592 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:29.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:29.633 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:29.633 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:29.649 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:29.650 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:29.650 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:29.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:29.690 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:29.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:29.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:29.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:30.651 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:30.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:30.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:30.750 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:30.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:30.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:30.802 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:30.812 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:30.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:30.860 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:30.860 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:30.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:30.884 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:30.884 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:30.916 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:30.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:30.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:30.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:30.940 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:30.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:30.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:30.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:31.917 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:31.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:31.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.016 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:32.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:32.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.068 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:32.078 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:32.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:32.125 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:32.125 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:32.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:32.151 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:32.151 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:32.182 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:32.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:32.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:32.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:32.207 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:32.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:32.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:32.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:33.183 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:33.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:33.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:33.282 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:33.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:33.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:33.334 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:33.345 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:33.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:33.394 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:33.394 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:33.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:33.416 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:33.416 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:33.451 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:33.451 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:33.451 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:33.451 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:33.473 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:33.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:33.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:33.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:34.452 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:34.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:34.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.551 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:34.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:34.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.603 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:34.614 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:34.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:34.662 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:34.662 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:34.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:34.690 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:34.690 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:34.719 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:34.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:34.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:34.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:34.747 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:34.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:34.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:34.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:35.720 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:35.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:35.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:35.819 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:35.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:35.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:35.871 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:35.882 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:35.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:35.929 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:35.929 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:35.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:35.966 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:35.966 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:35.985 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:35.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:35.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:35.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:36.023 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:36.023 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:36.023 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:36.023 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:36.987 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:36.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:36.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.086 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:37.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:37.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.139 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:37.149 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:37.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:37.197 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:37.197 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:37.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:37.222 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:37.222 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:37.254 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:37.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:37.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:37.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:37.279 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:37.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:37.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:37.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:38.255 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:38.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:38.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:38.354 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:38.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:38.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:38.406 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:38.417 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:38.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:38.465 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:38.465 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:38.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:38.494 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:38.494 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:38.523 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:38.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:38.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:38.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:38.551 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:38.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:38.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:38.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:39.524 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:39.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:39.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.623 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:39.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:39.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.675 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:39.685 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:39.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:39.733 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:39.733 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:39.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:39.764 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:39.764 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:39.790 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:39.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:39.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:39.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:39.820 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:39.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:39.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:39.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:40.791 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:40.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:40.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:40.890 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:40.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:40.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:40.943 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:40.954 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:41.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:41.000 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:41.000 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:41.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:41.038 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:41.038 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:41.056 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:41.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:41.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:41.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:41.094 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:41.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:41.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:41.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.057 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:42.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:42.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.157 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:42.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:42.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.209 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:42.220 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:42.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:42.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:42.269 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:42.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:42.294 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:42.294 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:42.325 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:42.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:42.325 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:42.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.350 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:42.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:42.351 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:42.351 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:43.327 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:43.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:43.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:43.427 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:43.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:43.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:43.479 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:43.490 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:43.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:43.537 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:43.537 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:43.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:43.570 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:43.570 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:43.594 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:43.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:43.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:43.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:43.626 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:43.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:43.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:43.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:44.595 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:44.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:44.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.694 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:44.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:44.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.747 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:44.758 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:44.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:44.806 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:44.807 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:44.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:44.833 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:44.833 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:44.864 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:44.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:44.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:44.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:44.891 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:44.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:44.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:44.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:45.866 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:45.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:45.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:45.967 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:45.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:45.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:46.019 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:46.030 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:46.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:46.077 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:46.078 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:46.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:46.111 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:46.112 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:46.135 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:46.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:46.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:46.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:46.170 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:46.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:46.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:46.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.136 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:47.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:47.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.222 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:47.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:47.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.273 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:47.284 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:47.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:47.331 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:47.331 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:47.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:47.369 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:47.369 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:47.388 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:47.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:47.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:47.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.426 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:47.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:47.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:47.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.390 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:48.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:48.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:48.489 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:48.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:48.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:48.542 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:48.553 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:48.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:48.601 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:48.602 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:48.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:48.626 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:48.626 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:48.658 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:48.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:48.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:48.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.683 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:48.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:48.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:48.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:49.659 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:49.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:49.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:49.729 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:49.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:49.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:49.780 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:49.791 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:49.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:49.839 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:49.839 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:49.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:49.873 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:49.873 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:49.897 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:49.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:49.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:49.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:49.930 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:49.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:49.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:49.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:50.898 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:50.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:50.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:50.996 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:50.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:50.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:51.048 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:51.059 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:51.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:51.106 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:51.106 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:51.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:51.133 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:51.133 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:51.162 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:51.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:51.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:51.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:51.190 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:51.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:51.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:51.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:52.163 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:52.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:52.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.262 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:52.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:52.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.313 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:52.324 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:52.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:52.372 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:52.372 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:52.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:52.400 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:52.400 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:52.430 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:52.430 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:52.430 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:52.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:52.456 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:52.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:52.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:52.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.430 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:53.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:53.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:53.530 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:53.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:53.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:53.582 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:53.593 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:53.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:53.641 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:53.641 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:53.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:53.673 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:53.674 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:53.698 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:53.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:53.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:53.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.730 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:53.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:53.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:53.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:54.699 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:54.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:54.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:54.798 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:54.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:54.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:54.850 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:54.860 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:54.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:54.908 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:54.908 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:54.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:54.931 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:54.932 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:54.964 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:54.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:54.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:54.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:54.988 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:54.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:54.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:54.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:55.965 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:55.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:55.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:56.064 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:56.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:56.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:56.116 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:56.127 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:56.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:56.173 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:56.174 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:56.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:56.207 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:56.207 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:56.231 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:56.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:56.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:56.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:56.264 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:56.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:56.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:56.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.232 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:57.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:57.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.331 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:57.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:57.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.383 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:57.393 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:57.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:57.441 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:57.441 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:57.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:57.478 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:57.478 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:57.499 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:57.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:57.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:57.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.535 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:57.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:57.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:57.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:58.501 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:58.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:58.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:58.605 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:58.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:58.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:58.657 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:58.667 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:58.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:58.716 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:58.716 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:57:58.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:58.756 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:58.756 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:57:58.773 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:58.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:58.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:58.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:58.813 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:58.814 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:58.814 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:58.814 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:59.775 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:57:59.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:59.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:59.874 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:57:59.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:57:59.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:59.925 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:57:59.936 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:57:59.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:57:59.982 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:59.982 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:00.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:00.022 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:00.022 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:00.039 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:00.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:00.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:00.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:00.079 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:00.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:00.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:00.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.040 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:01.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:01.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:01.139 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:01.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:01.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:01.190 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:01.201 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:01.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:01.248 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:01.248 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:01.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:01.278 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:01.278 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:01.305 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:01.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:01.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:01.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.335 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:01.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:01.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:01.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:02.306 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:02.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:02.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.406 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:02.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:02.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.459 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:02.470 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:02.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:02.518 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:02.518 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:02.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:02.544 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:02.545 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:02.576 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:02.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:02.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:02.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:02.602 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:02.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:02.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:02.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:03.577 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:03.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:03.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.676 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:03.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:03.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.729 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:03.739 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:03.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:03.787 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:03.787 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:03.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:03.821 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:03.821 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:03.843 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:03.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:03.844 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:03.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:03.879 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:03.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:03.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:03.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:04.845 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:04.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:04.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:04.942 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:04.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:04.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:04.995 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:05.005 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:05.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:05.053 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:05.053 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:05.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:05.078 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:05.079 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:05.109 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:05.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:05.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:05.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:05.135 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:05.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:05.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:05.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.110 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:06.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:06.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:06.210 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:06.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:06.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:06.262 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:06.272 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:06.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:06.321 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:06.321 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:06.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:06.359 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:06.359 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:06.377 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:06.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:06.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:06.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.416 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:06.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:06.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:06.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:07.378 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:07.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:07.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.476 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:07.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:07.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.528 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:07.538 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:07.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:07.586 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:07.586 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:07.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:07.615 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:07.616 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:07.643 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:07.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:07.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:07.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:07.672 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:07.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:07.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:07.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:08.644 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:08.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:08.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:08.742 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:08.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:08.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:08.794 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:08.804 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:08.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:08.852 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:08.853 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:08.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:08.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:08.890 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:08.910 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:08.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:08.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:08.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:08.948 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:08.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:08.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:08.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:09.911 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:09.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:09.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.010 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:10.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:10.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.062 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:10.073 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:10.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:10.120 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:10.120 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:10.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:10.156 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:10.156 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:10.177 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:10.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:10.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:10.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:10.213 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:10.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:10.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:10.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.179 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:11.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:11.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:11.278 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:11.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:11.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:11.330 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:11.341 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:11.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:11.389 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:11.389 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:11.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:11.420 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:11.420 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:11.446 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:11.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:11.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:11.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.477 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:11.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:11.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:11.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:12.448 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:12.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:12.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.546 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:12.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:12.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.598 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:12.609 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:12.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:12.657 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:12.657 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:12.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:12.685 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:12.685 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:12.713 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:12.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:12.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:12.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:12.742 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:12.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:12.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:12.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:13.714 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:13.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:13.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:13.812 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:13.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:13.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:13.863 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:13.874 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:13.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:13.922 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:13.922 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:13.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:13.948 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:13.948 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:13.979 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:13.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:13.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:13.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:14.005 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:14.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:14.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:14.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:14.980 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:14.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:14.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:15.078 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:15.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:15.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:15.130 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:15.141 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:15.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:15.188 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:15.188 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:15.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:15.218 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:15.218 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:15.245 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:15.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:15.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:15.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:15.275 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:15.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:15.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:15.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.246 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:16.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:16.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.347 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:16.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:16.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.398 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:16.409 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:16.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:16.456 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:16.456 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:16.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:16.488 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:16.488 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:16.512 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:16.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:16.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:16.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.546 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:16.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:16.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:16.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:17.513 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:17.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:17.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:17.612 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:17.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:17.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:17.664 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:17.675 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:17.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:17.722 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:17.722 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:17.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:17.748 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:17.748 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:17.780 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:17.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:17.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:17.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:17.806 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:17.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:17.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:17.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:18.781 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:18.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:18.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:18.881 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:18.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:18.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:18.933 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:18.943 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:18.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:18.991 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:18.991 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:19.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:19.015 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:19.015 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:19.047 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:19.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:19.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:19.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:19.073 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:19.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:19.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:19.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:20.049 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:20.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:20.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:20.150 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:20.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:20.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:20.202 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:20.212 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:20.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:20.260 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:20.260 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:20.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:20.288 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:20.289 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:20.317 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:20.317 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:20.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:20.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:20.346 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:20.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:20.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:20.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.319 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:21.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:21.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.418 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:21.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:21.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.470 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:21.481 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:21.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:21.530 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:21.531 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:21.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:21.561 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:21.561 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:21.588 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:21.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:21.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:21.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.620 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:21.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:21.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:21.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:22.588 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:22.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:22.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:22.687 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:22.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:22.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:22.740 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:22.750 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:22.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:22.800 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:22.800 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:22.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:22.837 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:22.838 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:22.858 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:22.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:22.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:22.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:22.895 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:22.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:22.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:22.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:23.859 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:23.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:23.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:23.920 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:23.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:23.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:23.976 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:23.985 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:23.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:23.992 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:23.992 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:24.050 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:24.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:24.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:24.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:24.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:24.063 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:24.063 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:24.120 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:24.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:24.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:24.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:25.051 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:25.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:25.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:25.151 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:25.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:25.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:25.204 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:25.213 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:25.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:25.264 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:25.264 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:25.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:25.291 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:25.291 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:25.322 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:25.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:25.322 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:25.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:25.348 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:25.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:25.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:25.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.323 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:26.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:26.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.422 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:26.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:26.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.474 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:26.485 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:26.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:26.532 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:26.532 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:26.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:26.560 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:26.560 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:26.589 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:26.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:26.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:26.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.617 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:26.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:26.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:26.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:27.591 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:27.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:27.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:27.689 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:27.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:27.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:27.741 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:27.752 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:27.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:27.800 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:27.800 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:27.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:27.828 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:27.828 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:27.856 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:27.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:27.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:27.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:27.884 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:27.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:27.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:27.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:28.858 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:28.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:28.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:28.957 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:28.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:28.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:29.008 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:29.019 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:29.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:29.066 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:29.066 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:29.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:29.100 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:29.100 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:29.124 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:29.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:29.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:29.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:29.157 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:29.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:29.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:29.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:30.125 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:30.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:30.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:30.224 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:30.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:30.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:30.276 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:30.287 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:30.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:30.334 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:30.334 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:30.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:30.360 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:30.360 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:30.391 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:30.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:30.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:30.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:30.417 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:30.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:30.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:30.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:31.392 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:31.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:31.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.493 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:31.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:31.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.545 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:31.556 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:31.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:31.601 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:31.601 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:31.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:31.637 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:31.637 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:31.658 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:31.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:31.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:31.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:31.693 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:31.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:31.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:31.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:32.659 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:32.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:32.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:32.760 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:32.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:32.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:32.811 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:32.822 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:32.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:32.870 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:32.870 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:32.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:32.904 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:32.904 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:32.927 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:32.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:32.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:32.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:32.960 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:32.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:32.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:32.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:33.928 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:33.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:33.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.029 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:34.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:34.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.081 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:34.091 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:34.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:34.140 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:34.140 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:34.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:34.178 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:34.178 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:34.196 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:34.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:34.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:34.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:34.235 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:34.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:34.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:34.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.197 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:35.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:35.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:35.298 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:35.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:35.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:35.350 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:35.360 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:35.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:35.410 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:35.410 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:35.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:35.443 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:35.443 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:35.466 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:35.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:35.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:35.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.500 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:35.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:35.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:35.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:36.468 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:36.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:36.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.568 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:36.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:36.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.620 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:36.630 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:36.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:36.678 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:36.678 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:36.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:36.710 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:36.710 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:36.735 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:36.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:36.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:36.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:36.768 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:36.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:36.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:36.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:37.736 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:37.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:37.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:37.836 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:37.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:37.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:37.888 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:37.898 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:37.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:37.946 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:37.946 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:37.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:37.977 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:37.977 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:38.003 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:38.003 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:38.003 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:38.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:38.034 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:38.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:38.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:38.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.004 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:39.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:39.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.104 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:39.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:39.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.156 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:39.166 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:39.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:39.214 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:39.214 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:39.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:39.238 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:39.238 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:39.271 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:39.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:39.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:39.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.296 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:39.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:39.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:39.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.272 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:40.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:40.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:40.373 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:40.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:40.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:40.426 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:40.437 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:40.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:40.485 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:40.485 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:40.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:40.524 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:40.524 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:40.541 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:40.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:40.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:40.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.582 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:40.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:40.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:40.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:41.542 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:41.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:41.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:41.640 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:41.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:41.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:41.692 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:41.702 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:41.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:41.749 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:41.749 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:41.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:41.777 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:41.778 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:41.806 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:41.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:41.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:41.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:41.834 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:41.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:41.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:41.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:42.807 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:42.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:42.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:42.905 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:42.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:42.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:42.957 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:42.968 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:43.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:43.014 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:43.014 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:43.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:43.055 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:43.055 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:43.070 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:43.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:43.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:43.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:43.112 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:43.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:43.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:43.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.072 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:44.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:44.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.170 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:44.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:44.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.222 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:44.233 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:44.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:44.281 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:44.281 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:44.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:44.320 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:44.320 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:44.339 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:44.339 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:44.339 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:44.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.377 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:44.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:44.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:44.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:45.341 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:45.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:45.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:45.438 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:45.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:45.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:45.490 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:45.500 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:45.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:45.548 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:45.549 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:45.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:45.589 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:45.589 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:45.605 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:45.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:45.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:45.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:45.646 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:45.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:45.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:45.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:46.607 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:46.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:46.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:46.710 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:46.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:46.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:46.762 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:46.772 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:46.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:46.820 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:46.820 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:46.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:46.853 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:46.853 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:46.877 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:46.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:46.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:46.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:46.911 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:46.911 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:46.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:46.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:47.877 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:47.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:47.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:47.976 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:47.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:47.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:48.028 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:48.039 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:48.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:48.086 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:48.086 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:48.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:48.127 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:48.127 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:48.144 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:48.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:48.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:48.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:48.184 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:48.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:48.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:48.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.145 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:49.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:49.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.226 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:49.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:49.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.280 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:49.291 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:49.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:49.340 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:49.340 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:49.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:49.374 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:49.374 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:49.396 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:49.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:49.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:49.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.432 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:49.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:49.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:49.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:50.397 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:50.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:50.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:50.474 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:50.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:50.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:50.527 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:50.538 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:50.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:50.585 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:50.585 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:50.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:50.623 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:50.623 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:50.642 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:50.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:50.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:50.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:50.680 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:50.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:50.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:50.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:51.644 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:51.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:51.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:51.729 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:51.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:51.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:51.782 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:51.793 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:51.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:51.842 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:51.842 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:51.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:51.881 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:51.881 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:51.899 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:51.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:51.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:51.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:51.938 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:51.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:51.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:51.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:52.900 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:52.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:52.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:52.984 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:52.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:52.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:53.036 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:53.046 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:53.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:53.095 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:53.095 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:53.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:53.125 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:53.125 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:53.152 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:53.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:53.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:53.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:53.182 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:53.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:53.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:53.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:54.153 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:54.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:54.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.248 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:54.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:54.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.300 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:54.311 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:54.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:54.359 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:54.359 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:54.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:54.405 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:54.406 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:54.415 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:54.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:54.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:54.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:54.462 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:54.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:54.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:54.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:55.417 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:55.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:55.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.515 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:55.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:55.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.567 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:55.577 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:55.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:55.626 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:55.627 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:55.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:55.658 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:55.658 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:55.684 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:55.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:55.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:55.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:55.715 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:55.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:55.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:55.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:56.685 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:56.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:56.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:56.746 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:56.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:56.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:56.797 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:56.808 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:56.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:56.856 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:56.856 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:56.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:56.883 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:56.883 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:56.913 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:56.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:56.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:56.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:56.939 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:56.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:56.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:56.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:57.913 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:57.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:57.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:57.972 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:57.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:57.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:58.023 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:58.034 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:58.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:58.082 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:58.083 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:58.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:58.111 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:58.111 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:58.140 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:58.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:58.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:58.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:58.168 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:58.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:58.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:58.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:59.141 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:58:59.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:59.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.240 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:58:59.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:59.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.294 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:58:59.305 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:58:59.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:58:59.314 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:59.314 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:58:59.370 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:59.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:59.371 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:59.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:59.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:58:59.382 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:59.382 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:58:59.439 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:59.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:59.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:59.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:00.371 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:59:00.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:59:00.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.472 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:59:00.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:59:00.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.525 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:59:00.535 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:59:00.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:59:00.583 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:00.583 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:59:00.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:59:00.619 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:00.619 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:59:00.641 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:00.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:00.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:00.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:00.676 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:00.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:00.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:00.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:01.642 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:59:01.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:59:01.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:01.740 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:59:01.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:59:01.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:01.791 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:59:01.802 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:59:01.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:59:01.849 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:01.849 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:59:01.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:59:01.877 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:01.877 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:59:01.906 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:01.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:01.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:01.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:01.934 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:01.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:01.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:01.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:02.907 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2026-02-12T22:59:02.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:59:02.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:03.005 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-12T22:59:03.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:59:03.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:03.058 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-12T22:59:03.068 DEBUG:teuthology.orchestra.run.trial149:> true 2026-02-12T22:59:03.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-12T22:59:03.116 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:03.117 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-12T22:59:03.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial149.front.sepia.ceph.com' 2026-02-12T22:59:03.152 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:03.152 DEBUG:teuthology.orchestra.run.trial149:> uname -r 2026-02-12T22:59:03.172 INFO:teuthology.orchestra.run.trial185.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:03.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:03.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:03.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.173 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.175 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:59:03.187 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:59:03.219 INFO:teuthology.run:Summary data: description: fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/admin} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:59:03.219 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:59:03.300 INFO:teuthology.orchestra.run.trial149.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:03.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:03.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:03.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.345 INFO:teuthology.run:FAIL