2026-02-12T22:40:05.151 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:40:05.167 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:40:05.250 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47264 branch: wip-pdonnell-testing-20260210.171210 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47264' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 fuse set user groups: true mds: mds oft prefetch dirfrags: false mds_sleep_rank_change: 5000000.0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - Replacing daemon mds sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUQML7QmeQu/+190+Y3NTcorhweTIaUBLSeTFgZ7/6f4FhdKcCAivT0+67gxph7MplKT6eN/ZbC9UjdWQee3iI= trial132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIjfbzw2udNhyO+e3ZkPwjDZZZdd4vbR6QwBnpr0/6jd7RbSbGSMVTxprrOmY6jemfZ2tUk/tLsx2AKTop5XMrI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - mds_thrash: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:40:05.250 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:40:05.250 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:40:05.250 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:40:05.252 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:40:05.252 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:40:05.252 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:40:05.252 INFO:teuthology.packaging:ref: None 2026-02-12T22:40:05.252 INFO:teuthology.packaging:tag: None 2026-02-12T22:40:05.252 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:40:05.252 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:40:05.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:40:05.376 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:40:05.377 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:40:05.387 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:40:05.387 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:40:05.400 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:40:05.419 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:40:05.432 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:40:05.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial033.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47264', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:36:41.947209', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUQML7QmeQu/+190+Y3NTcorhweTIaUBLSeTFgZ7/6f4FhdKcCAivT0+67gxph7MplKT6eN/ZbC9UjdWQee3iI='} 2026-02-12T22:40:05.560 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial132.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47264', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:36:41.946577', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIjfbzw2udNhyO+e3ZkPwjDZZZdd4vbR6QwBnpr0/6jd7RbSbGSMVTxprrOmY6jemfZ2tUk/tLsx2AKTop5XMrI='} 2026-02-12T22:40:05.560 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:40:05.572 INFO:teuthology.task.internal:roles: ubuntu@trial033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:40:05.572 INFO:teuthology.task.internal:roles: ubuntu@trial132.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:40:05.572 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:40:05.705 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x78f96f1baa20>, signals=[15]) 2026-02-12T22:40:05.705 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:40:05.717 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:40:05.717 DEBUG:teuthology.task.internal:connecting to ubuntu@trial033.front.sepia.ceph.com 2026-02-12T22:40:05.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:40:05.776 DEBUG:teuthology.task.internal:connecting to ubuntu@trial132.front.sepia.ceph.com 2026-02-12T22:40:05.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:40:05.836 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:40:05.851 DEBUG:teuthology.orchestra.run.trial033:> uname -m 2026-02-12T22:40:05.868 INFO:teuthology.orchestra.run.trial033.stdout:x86_64 2026-02-12T22:40:05.868 DEBUG:teuthology.orchestra.run.trial033:> cat /etc/os-release 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:NAME="Rocky Linux" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:ID="rocky" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:VERSION_ID="10.1" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:ANSI_COLOR="0;32" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:VENDOR_NAME="RESF" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:40:05.925 INFO:teuthology.orchestra.run.trial033.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:40:05.926 INFO:teuthology.orchestra.run.trial033.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:40:05.926 INFO:teuthology.orchestra.run.trial033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:40:05.926 INFO:teuthology.lock.ops:Updating trial033.front.sepia.ceph.com on lock server 2026-02-12T22:40:05.998 DEBUG:teuthology.orchestra.run.trial132:> uname -m 2026-02-12T22:40:06.015 INFO:teuthology.orchestra.run.trial132.stdout:x86_64 2026-02-12T22:40:06.015 DEBUG:teuthology.orchestra.run.trial132:> cat /etc/os-release 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:NAME="Rocky Linux" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:ID="rocky" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:VERSION_ID="10.1" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:40:06.073 INFO:teuthology.orchestra.run.trial132.stdout:ANSI_COLOR="0;32" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:VENDOR_NAME="RESF" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:40:06.074 INFO:teuthology.orchestra.run.trial132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:40:06.074 INFO:teuthology.lock.ops:Updating trial132.front.sepia.ceph.com on lock server 2026-02-12T22:40:06.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:40:06.165 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:40:06.177 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:40:06.177 DEBUG:teuthology.orchestra.run.trial033:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:40:06.179 DEBUG:teuthology.orchestra.run.trial132:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:40:06.196 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:40:06.210 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:40:06.210 DEBUG:teuthology.orchestra.run.trial033:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:40:06.236 DEBUG:teuthology.orchestra.run.trial132:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:40:06.251 INFO:teuthology.orchestra.run.trial033.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:40:06.253 INFO:teuthology.orchestra.run.trial132.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:40:06.253 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:40:06.396 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:40:06.415 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:40:06.415 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:40:06.416 DEBUG:teuthology.orchestra.run.trial033:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:40:06.416 DEBUG:teuthology.orchestra.run.trial132:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:40:06.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:40:06.432 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:40:06.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:40:06.432 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:40:06.488 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:40:06.489 INFO:teuthology.task.kernel:Running kernel on trial132: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:40:06.489 DEBUG:teuthology.orchestra.run.trial132:> sudo yum install -y kernel 2026-02-12T22:40:06.489 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:40:06.489 INFO:teuthology.task.kernel:Running kernel on trial033: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:40:06.489 DEBUG:teuthology.orchestra.run.trial033:> sudo yum install -y kernel 2026-02-12T22:40:06.988 INFO:teuthology.orchestra.run.trial132.stdout:Rocky Linux 10 - AppStream 22 MB/s | 2.2 MB 00:00 2026-02-12T22:40:06.992 INFO:teuthology.orchestra.run.trial033.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:40:07.344 INFO:teuthology.orchestra.run.trial132.stdout:Rocky Linux 10 - BaseOS 49 MB/s | 11 MB 00:00 2026-02-12T22:40:07.430 INFO:teuthology.orchestra.run.trial033.stdout:Rocky Linux 10 - BaseOS 35 MB/s | 11 MB 00:00 2026-02-12T22:40:07.835 INFO:teuthology.orchestra.run.trial132.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 507 kB 00:00 2026-02-12T22:40:07.916 INFO:teuthology.orchestra.run.trial033.stdout:Rocky Linux 10 - CRB 6.3 MB/s | 507 kB 00:00 2026-02-12T22:40:08.503 INFO:teuthology.orchestra.run.trial033.stdout:Extra Packages for Enterprise Linux 12 MB/s | 6.2 MB 00:00 2026-02-12T22:40:08.832 INFO:teuthology.orchestra.run.trial132.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 6.2 MB 00:00 2026-02-12T22:40:09.167 INFO:teuthology.orchestra.run.trial033.stdout:lab-extras 176 kB/s | 3.7 kB 00:00 2026-02-12T22:40:09.493 INFO:teuthology.orchestra.run.trial132.stdout:lab-extras 297 kB/s | 3.7 kB 00:00 2026-02-12T22:40:09.575 INFO:teuthology.orchestra.run.trial033.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:40:09.586 INFO:teuthology.orchestra.run.trial033.stdout:Dependencies resolved. 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout:================================================================================ 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout: Package Arch Version Repo Size 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout:================================================================================ 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout:Installing: 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout:Installing dependencies: 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:40:09.588 INFO:teuthology.orchestra.run.trial033.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout: 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout:Transaction Summary 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout:================================================================================ 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout:Install 5 Packages 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout: 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout:Total download size: 93 M 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout:Installed size: 135 M 2026-02-12T22:40:09.589 INFO:teuthology.orchestra.run.trial033.stdout:Downloading Packages: 2026-02-12T22:40:09.642 INFO:teuthology.orchestra.run.trial033.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:40:09.891 INFO:teuthology.orchestra.run.trial033.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 61 MB/s | 18 MB 00:00 2026-02-12T22:40:09.906 INFO:teuthology.orchestra.run.trial132.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:40:09.918 INFO:teuthology.orchestra.run.trial132.stdout:Dependencies resolved. 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout: Package Arch Version Repo Size 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout:Installing: 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout:Installing dependencies: 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:40:09.920 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout:Transaction Summary 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout:================================================================================ 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout:Install 5 Packages 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout:Total download size: 93 M 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout:Installed size: 135 M 2026-02-12T22:40:09.921 INFO:teuthology.orchestra.run.trial132.stdout:Downloading Packages: 2026-02-12T22:40:09.943 INFO:teuthology.orchestra.run.trial033.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 54 MB/s | 2.8 MB 00:00 2026-02-12T22:40:09.971 INFO:teuthology.orchestra.run.trial132.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 27 MB/s | 1.4 MB 00:00 2026-02-12T22:40:09.995 INFO:teuthology.orchestra.run.trial033.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 84 MB/s | 30 MB 00:00 2026-02-12T22:40:10.189 INFO:teuthology.orchestra.run.trial132.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 69 MB/s | 18 MB 00:00 2026-02-12T22:40:10.240 INFO:teuthology.orchestra.run.trial132.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 55 MB/s | 2.8 MB 00:00 2026-02-12T22:40:10.355 INFO:teuthology.orchestra.run.trial033.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 53 MB/s | 41 MB 00:00 2026-02-12T22:40:10.356 INFO:teuthology.orchestra.run.trial033.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:40:10.356 INFO:teuthology.orchestra.run.trial033.stdout:Total 121 MB/s | 93 MB 00:00 2026-02-12T22:40:10.356 INFO:teuthology.orchestra.run.trial033.stdout:Running transaction check 2026-02-12T22:40:10.364 INFO:teuthology.orchestra.run.trial132.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 75 MB/s | 30 MB 00:00 2026-02-12T22:40:10.500 INFO:teuthology.orchestra.run.trial033.stdout:Transaction check succeeded. 2026-02-12T22:40:10.500 INFO:teuthology.orchestra.run.trial033.stdout:Running transaction test 2026-02-12T22:40:10.550 INFO:teuthology.orchestra.run.trial132.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 65 MB/s | 41 MB 00:00 2026-02-12T22:40:10.551 INFO:teuthology.orchestra.run.trial132.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:40:10.551 INFO:teuthology.orchestra.run.trial132.stdout:Total 147 MB/s | 93 MB 00:00 2026-02-12T22:40:10.551 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction check 2026-02-12T22:40:10.696 INFO:teuthology.orchestra.run.trial132.stdout:Transaction check succeeded. 2026-02-12T22:40:10.696 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction test 2026-02-12T22:40:10.901 INFO:teuthology.orchestra.run.trial033.stdout:Transaction test succeeded. 2026-02-12T22:40:10.902 INFO:teuthology.orchestra.run.trial033.stdout:Running transaction 2026-02-12T22:40:11.101 INFO:teuthology.orchestra.run.trial132.stdout:Transaction test succeeded. 2026-02-12T22:40:11.101 INFO:teuthology.orchestra.run.trial132.stdout:Running transaction 2026-02-12T22:40:11.596 INFO:teuthology.orchestra.run.trial033.stdout: Preparing : 1/1 2026-02-12T22:40:11.796 INFO:teuthology.orchestra.run.trial132.stdout: Preparing : 1/1 2026-02-12T22:40:11.798 INFO:teuthology.orchestra.run.trial033.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:40:11.820 INFO:teuthology.orchestra.run.trial033.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:40:11.998 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:40:12.020 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:40:13.086 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:40:13.115 INFO:teuthology.orchestra.run.trial033.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:40:13.288 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:40:13.314 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:40:14.958 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:40:14.964 INFO:teuthology.orchestra.run.trial033.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:40:15.158 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:40:15.164 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:40:16.822 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:40:16.832 INFO:teuthology.orchestra.run.trial033.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:17.021 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:40:17.031 INFO:teuthology.orchestra.run.trial132.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:18.697 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:18.895 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.386 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.410 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.646 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout: 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout:Installed: 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.650 INFO:teuthology.orchestra.run.trial033.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.651 INFO:teuthology.orchestra.run.trial033.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.651 INFO:teuthology.orchestra.run.trial033.stdout: 2026-02-12T22:40:52.651 INFO:teuthology.orchestra.run.trial033.stdout:Complete! 2026-02-12T22:40:52.670 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.715 DEBUG:teuthology.orchestra.run.trial033:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:40:52.789 INFO:teuthology.orchestra.run.trial033.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.790 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.791 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.791 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:40:52.791 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:40:52.791 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:40:52.791 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial033.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:40:52.791 DEBUG:teuthology.orchestra.run.trial033:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:40:52.863 INFO:teuthology.orchestra.run.trial033.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.864 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.865 DEBUG:teuthology.orchestra.run.trial033:> sudo rpm -qi grub2-tools 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout:Installed: 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.903 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.904 INFO:teuthology.orchestra.run.trial132.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.904 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-12T22:40:52.904 INFO:teuthology.orchestra.run.trial132.stdout:Complete! 2026-02-12T22:40:52.935 INFO:teuthology.orchestra.run.trial033.stdout:Name : grub2-tools 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Epoch : 1 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Version : 2.12 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Release : 29.el10_1 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Architecture: x86_64 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Group : Unspecified 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Size : 7963769 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:License : GPL-3.0-or-later 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout:Signature : 2026-02-12T22:40:52.936 INFO:teuthology.orchestra.run.trial033.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Packager : Release Engineering 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Summary : Support tools for GRUB. 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:Description : 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout: 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:40:52.937 INFO:teuthology.orchestra.run.trial033.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:40:52.938 INFO:teuthology.orchestra.run.trial033.stdout:hardware devices. 2026-02-12T22:40:52.938 INFO:teuthology.orchestra.run.trial033.stdout: 2026-02-12T22:40:52.938 INFO:teuthology.orchestra.run.trial033.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:40:52.939 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:40:52.939 INFO:teuthology.task.kernel:Updating grub on trial033 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:52.939 DEBUG:teuthology.orchestra.run.trial033:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:40:52.968 DEBUG:teuthology.orchestra.run.trial132:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:40:53.002 INFO:teuthology.orchestra.run.trial132.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.003 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.003 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.004 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:40:53.004 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:40:53.004 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:40:53.004 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial132.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:40:53.004 DEBUG:teuthology.orchestra.run.trial132:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:40:53.005 INFO:teuthology.orchestra.run.trial033.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:40:53.006 DEBUG:teuthology.orchestra.run.trial033:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:40:53.072 INFO:teuthology.orchestra.run.trial033.stdout:/sbin/grubby 2026-02-12T22:40:53.074 INFO:teuthology.orchestra.run.trial033.stdout:yes 2026-02-12T22:40:53.074 DEBUG:teuthology.orchestra.run.trial033:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:40:53.075 INFO:teuthology.orchestra.run.trial132.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.076 DEBUG:teuthology.orchestra.run.trial132:> sudo rpm -qi grub2-tools 2026-02-12T22:40:53.140 INFO:teuthology.orchestra.run.trial033.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:40:53.141 DEBUG:teuthology.orchestra.run.trial033:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Name : grub2-tools 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Epoch : 1 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Version : 2.12 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Release : 29.el10_1 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Architecture: x86_64 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Group : Unspecified 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:Size : 7963769 2026-02-12T22:40:53.147 INFO:teuthology.orchestra.run.trial132.stdout:License : GPL-3.0-or-later 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Signature : 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Packager : Release Engineering 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Summary : Support tools for GRUB. 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:Description : 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:40:53.148 INFO:teuthology.orchestra.run.trial132.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:40:53.149 INFO:teuthology.orchestra.run.trial132.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:40:53.149 INFO:teuthology.orchestra.run.trial132.stdout:hardware devices. 2026-02-12T22:40:53.149 INFO:teuthology.orchestra.run.trial132.stdout: 2026-02-12T22:40:53.149 INFO:teuthology.orchestra.run.trial132.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:40:53.150 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:40:53.150 INFO:teuthology.task.kernel:Updating grub on trial132 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.150 DEBUG:teuthology.orchestra.run.trial132:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:40:53.215 INFO:teuthology.orchestra.run.trial132.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:40:53.217 DEBUG:teuthology.orchestra.run.trial132:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:40:53.218 DEBUG:teuthology.orchestra.run.trial033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:40:53.282 INFO:teuthology.orchestra.run.trial132.stdout:/sbin/grubby 2026-02-12T22:40:53.284 INFO:teuthology.orchestra.run.trial132.stdout:yes 2026-02-12T22:40:53.284 DEBUG:teuthology.orchestra.run.trial132:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:40:53.330 INFO:teuthology.orchestra.run.trial033.stderr:Generating grub configuration file ... 2026-02-12T22:40:53.350 INFO:teuthology.orchestra.run.trial132.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:40:53.351 DEBUG:teuthology.orchestra.run.trial132:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:40:53.428 DEBUG:teuthology.orchestra.run.trial132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:40:53.509 INFO:teuthology.orchestra.run.trial033.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:40:53.518 INFO:teuthology.orchestra.run.trial033.stderr:done 2026-02-12T22:40:53.520 DEBUG:teuthology.orchestra.run.trial033:> test -d /sys/firmware/efi 2026-02-12T22:40:53.538 DEBUG:teuthology.orchestra.run.trial033:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:40:53.539 INFO:teuthology.orchestra.run.trial132.stderr:Generating grub configuration file ... 2026-02-12T22:40:53.609 INFO:teuthology.orchestra.run.trial033.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:40:53.610 INFO:teuthology.orchestra.run.trial033.stdout:/boot/efi/EFI/rocky 2026-02-12T22:40:53.611 DEBUG:teuthology.orchestra.run.trial033:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:40:53.679 INFO:teuthology.orchestra.run.trial033.stdout:no 2026-02-12T22:40:53.680 DEBUG:teuthology.orchestra.run.trial033:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:40:53.718 INFO:teuthology.orchestra.run.trial132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:40:53.727 INFO:teuthology.orchestra.run.trial132.stderr:done 2026-02-12T22:40:53.729 DEBUG:teuthology.orchestra.run.trial132:> test -d /sys/firmware/efi 2026-02-12T22:40:53.745 INFO:teuthology.orchestra.run.trial033.stdout:yes 2026-02-12T22:40:53.746 DEBUG:teuthology.orchestra.run.trial033:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:40:53.747 DEBUG:teuthology.orchestra.run.trial132:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:40:53.812 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial033 2026-02-12T22:40:53.812 DEBUG:teuthology.orchestra.run.trial033:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:40:53.818 INFO:teuthology.orchestra.run.trial132.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:40:53.818 INFO:teuthology.orchestra.run.trial132.stdout:/boot/efi/EFI/rocky 2026-02-12T22:40:53.820 DEBUG:teuthology.orchestra.run.trial132:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:40:53.878 INFO:teuthology.orchestra.run.trial033.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:40:53.887 INFO:teuthology.orchestra.run.trial132.stdout:no 2026-02-12T22:40:53.887 DEBUG:teuthology.orchestra.run.trial132:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:40:53.953 INFO:teuthology.orchestra.run.trial132.stdout:yes 2026-02-12T22:40:53.953 DEBUG:teuthology.orchestra.run.trial132:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:40:54.020 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial132 2026-02-12T22:40:54.020 DEBUG:teuthology.orchestra.run.trial132:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:40:54.084 INFO:teuthology.orchestra.run.trial132.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:41:23.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:23.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:23.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:23.944 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:24.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:24.035 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:24.035 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:24.062 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:24.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:24.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:24.158 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:24.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:24.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:24.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:24.169 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:24.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:24.250 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:24.250 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:24.308 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:24.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:24.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:24.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:25.159 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:25.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:25.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:25.266 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:25.310 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:25.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:25.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:25.392 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:25.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:25.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:25.399 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:25.456 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:25.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:25.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:25.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:25.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:25.475 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:25.475 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:25.533 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:25.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:25.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:25.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:26.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:26.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:26.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:26.554 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:26.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:26.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:26.607 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:26.616 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:26.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:26.625 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:26.625 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:26.682 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:26.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:26.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:26.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:26.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:26.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:26.688 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:26.746 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:26.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:26.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:26.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:27.684 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:27.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:27.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:27.780 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:27.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:27.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:27.832 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:27.842 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:27.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:27.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:27.850 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:27.906 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:27.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:27.906 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:27.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:27.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:27.913 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:27.913 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:27.970 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:27.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:27.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:27.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:28.906 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:28.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:28.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:28.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:28.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:28.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:29.024 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:29.034 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:29.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:29.041 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:29.041 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:29.097 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:29.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:29.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:29.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:29.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:29.114 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:29.114 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:29.171 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:29.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:29.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:29.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:30.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:30.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:30.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:30.198 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:30.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:30.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:30.250 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:30.260 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:30.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:30.268 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:30.268 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:30.326 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:30.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:30.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:30.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:30.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:30.343 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:30.343 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:30.400 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:30.400 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:30.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:30.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:31.328 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:31.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:31.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:31.434 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:31.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:31.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:31.485 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:31.495 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:31.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:31.502 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:31.502 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:31.559 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:31.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:31.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:31.559 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:31.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:31.567 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:31.567 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:31.624 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:31.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:31.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:31.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:32.559 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:32.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:32.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:32.651 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:32.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:32.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:32.703 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:32.713 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:32.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:32.720 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:32.720 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:32.777 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:32.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:32.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:32.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:32.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:32.795 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:32.795 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:32.852 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:32.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:32.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:32.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:33.778 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:33.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:33.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:33.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:33.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:33.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:33.932 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:33.942 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:33.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:33.950 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:33.950 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:34.007 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:34.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:34.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:34.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:34.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:34.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:34.018 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:34.076 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:34.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:34.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:34.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:35.008 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:35.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:35.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:35.107 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:35.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:35.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:35.159 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:35.169 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:35.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:35.176 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:35.176 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:35.233 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:35.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:35.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:35.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:35.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:35.258 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:35.258 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:35.315 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:35.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:35.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:35.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:36.234 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:36.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:36.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:36.325 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:36.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:36.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:36.382 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:36.392 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:36.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:36.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:36.399 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:36.456 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:36.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:36.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:36.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:36.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:36.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:36.471 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:36.528 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:36.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:36.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:36.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:37.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:37.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:37.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:37.557 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:37.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:37.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:37.608 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:37.618 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:37.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:37.626 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:37.626 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:37.685 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:37.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:37.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:37.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:37.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:37.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:37.692 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:37.749 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:37.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:37.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:37.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:38.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:38.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:38.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:38.784 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:38.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:38.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:38.835 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:38.845 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:38.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:38.853 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:38.853 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:38.910 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:38.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:38.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:38.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:38.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:38.917 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:38.917 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:38.975 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:38.975 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:38.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:38.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:39.911 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:39.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:39.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:40.011 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:40.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:40.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:40.064 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:40.074 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:40.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:40.082 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:40.082 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:40.139 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:40.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:40.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:40.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:40.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:40.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:40.159 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:40.216 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:40.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:40.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:40.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:41.141 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:41.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:41.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:41.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:41.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:41.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:41.292 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:41.302 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:41.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:41.309 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:41.309 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:41.367 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:41.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:41.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:41.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:41.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:41.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:41.378 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:41.436 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:41.437 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:41.437 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:41.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:42.368 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:42.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:42.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:42.466 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:42.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:42.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:42.518 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:42.528 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:42.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:42.535 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:42.536 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:42.592 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:42.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:42.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:42.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:42.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:42.603 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:42.603 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:42.660 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:42.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:42.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:42.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:43.593 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:43.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:43.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:43.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:43.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:43.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:43.715 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:43.726 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:43.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:43.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:43.733 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:43.789 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:43.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:43.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:43.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:43.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:43.803 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:43.803 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:43.860 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:43.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:43.861 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:43.861 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:44.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:44.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:44.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:44.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:44.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:44.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:44.941 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:44.951 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:45.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:45.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:45.000 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:45.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:45.041 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:45.041 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:45.058 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:45.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:45.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:45.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:45.097 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:45.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:45.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:45.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:46.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:46.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:46.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:46.159 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:46.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:46.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:46.169 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:46.222 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:46.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:46.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:46.250 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:46.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:46.305 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:46.305 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:46.306 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:46.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:46.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:46.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:46.363 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:46.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:46.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:46.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:47.307 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:47.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:47.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:47.433 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:47.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:47.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:47.457 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:47.512 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:47.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:47.521 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:47.521 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:47.577 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:47.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:47.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:47.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:47.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:47.587 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:47.587 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:47.644 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:47.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:47.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:47.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:48.578 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:48.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:48.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:48.677 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:48.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:48.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:48.730 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:48.740 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:48.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:48.749 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:48.749 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:48.806 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:48.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:48.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:48.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:48.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:48.824 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:48.824 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:48.882 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:48.882 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:48.882 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:48.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:49.807 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:49.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:49.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:49.905 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:49.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:49.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:49.957 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:49.967 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:49.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:49.975 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:49.975 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:50.032 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:50.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:50.032 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:50.032 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:50.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:50.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:50.038 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:50.095 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:50.096 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:50.096 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:50.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:51.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:51.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:51.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:51.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:51.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:51.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:51.182 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:51.192 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:51.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:51.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:51.200 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:51.257 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:51.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:51.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:51.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:51.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:51.268 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:51.268 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:51.325 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:51.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:51.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:51.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:52.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:52.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:52.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:52.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:52.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:52.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:52.409 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:52.419 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:52.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:52.427 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:52.427 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:52.484 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:52.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:52.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:52.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:52.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:52.503 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:52.503 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:52.560 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:52.560 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:52.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:52.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:53.485 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:53.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:53.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:53.584 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:53.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:53.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:53.636 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:53.646 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:53.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:53.654 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:53.654 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:53.711 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:53.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:53.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:53.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:53.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:53.731 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:53.732 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:53.788 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:53.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:53.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:53.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:54.713 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:54.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:54.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:54.813 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:54.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:54.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:54.865 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:54.875 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:54.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:54.883 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:54.883 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:54.939 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:54.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:54.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:54.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:54.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:54.959 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:54.959 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:55.016 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:55.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:55.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:55.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:55.940 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:55.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:55.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:56.038 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:56.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:56.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:56.091 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:56.101 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:56.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:56.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:56.108 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:56.165 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:56.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:56.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:56.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:56.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:56.185 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:56.185 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:56.242 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:56.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:56.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:56.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:57.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:57.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:57.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:57.264 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:57.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:57.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:57.317 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:57.327 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:57.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:57.334 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:57.334 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:57.391 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:57.391 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:57.391 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:57.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:57.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:57.412 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:57.413 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:57.469 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:57.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:57.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:57.470 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:58.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:58.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:58.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:58.491 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:58.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:58.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:58.543 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:58.553 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:58.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:58.561 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:58.561 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:58.618 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:58.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:58.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:58.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:58.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:58.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:58.633 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:58.689 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:58.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:58.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:58.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:59.619 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:41:59.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:59.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:59.691 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:41:59.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:59.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:41:59.692 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:41:59.769 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:41:59.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:41:59.780 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:59.780 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:41:59.837 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:59.837 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:59.837 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:59.837 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:41:59.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:41:59.856 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:41:59.856 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:41:59.914 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:41:59.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:41:59.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:41:59.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:00.838 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:00.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:00.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:00.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:00.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:00.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:00.989 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:01.000 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:01.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:01.007 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:01.007 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:01.063 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:01.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:01.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:01.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:01.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:01.082 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:01.082 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:01.139 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:01.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:01.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:01.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:02.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:02.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:02.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:02.164 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:02.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:02.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:02.215 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:02.225 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:02.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:02.233 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:02.233 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:02.290 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:02.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:02.290 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:02.290 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:02.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:02.308 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:02.308 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:02.364 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:02.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:02.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:02.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:03.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:03.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:03.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:03.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:03.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:03.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:03.441 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:03.451 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:03.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:03.458 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:03.458 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:03.516 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:03.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:03.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:03.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:03.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:03.541 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:03.541 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:03.600 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:03.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:03.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:03.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:04.517 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:04.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:04.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:04.617 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:04.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:04.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:04.670 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:04.680 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:04.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:04.687 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:04.688 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:04.744 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:04.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:04.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:04.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:04.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:04.756 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:04.756 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:04.814 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:04.814 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:04.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:04.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:05.744 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:05.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:05.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:05.843 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:05.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:05.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:05.895 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:05.905 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:05.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:05.912 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:05.913 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:05.970 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:05.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:05.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:05.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:05.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:05.984 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:05.984 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:06.041 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:06.041 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:06.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:06.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:06.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:06.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:06.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:07.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:07.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:07.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:07.078 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:07.131 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:07.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:07.153 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:07.153 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:07.210 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:07.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:07.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:07.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:07.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:07.214 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:07.214 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:07.272 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:07.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:07.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:07.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:08.211 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:08.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:08.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:08.309 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:08.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:08.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:08.361 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:08.371 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:08.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:08.378 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:08.378 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:08.435 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:08.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:08.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:08.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:08.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:08.460 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:08.461 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:08.517 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:08.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:08.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:08.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:09.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:09.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:09.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:09.535 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:09.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:09.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:09.587 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:09.597 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:09.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:09.605 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:09.605 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:09.662 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:09.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:09.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:09.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:09.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:09.680 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:09.680 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:09.738 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:09.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:09.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:09.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:10.664 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:10.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:10.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:10.764 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:10.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:10.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:10.817 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:10.827 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:10.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:10.835 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:10.835 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:10.892 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:10.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:10.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:10.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:10.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:10.913 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:10.914 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:10.971 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:10.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:10.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:10.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:11.894 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:11.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:11.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:11.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:11.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:11.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:11.982 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:12.054 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:12.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:12.062 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:12.062 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:12.119 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:12.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:12.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:12.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:12.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:12.129 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:12.129 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:12.186 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:12.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:12.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:12.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:13.121 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:13.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:13.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:13.219 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:13.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:13.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:13.272 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:13.282 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:13.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:13.289 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:13.289 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:13.346 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:13.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:13.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:13.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:13.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:13.356 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:13.356 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:13.413 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:13.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:13.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:13.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:14.347 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:14.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:14.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:14.446 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:14.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:14.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:14.498 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:14.509 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:14.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:14.516 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:14.516 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:14.573 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:14.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:14.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:14.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:14.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:14.591 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:14.591 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:14.649 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:14.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:14.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:14.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:15.574 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:15.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:15.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:15.672 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:15.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:15.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:15.724 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:15.734 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:15.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:15.742 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:15.742 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:15.798 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:15.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:15.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:15.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:15.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:15.819 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:15.819 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:15.875 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:15.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:15.876 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:15.876 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:16.799 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:16.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:16.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:16.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:16.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:16.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:16.951 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:16.961 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:16.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:16.969 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:16.969 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:17.026 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:17.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:17.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:17.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:17.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:17.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:17.038 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:17.096 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:17.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:17.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:17.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:18.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:18.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:18.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:18.125 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:18.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:18.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:18.178 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:18.188 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:18.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:18.195 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:18.195 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:18.252 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:18.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:18.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:18.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:18.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:18.268 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:18.269 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:18.326 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:18.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:18.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:18.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:19.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:19.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:19.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:19.351 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:19.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:19.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:19.402 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:19.412 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:19.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:19.419 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:19.420 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:19.475 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:19.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:19.476 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:19.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:19.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:19.491 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:19.491 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:19.549 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:19.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:19.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:19.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:20.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:20.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:20.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:20.550 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:20.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:20.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:20.553 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:20.614 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:20.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:20.636 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:20.636 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:20.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:20.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:20.688 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:20.693 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:20.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:20.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:20.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:20.744 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:20.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:20.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:20.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:21.694 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:21.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:21.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:21.792 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:21.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:21.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:21.844 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:21.854 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:21.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:21.862 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:21.862 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:21.920 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:21.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:21.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:21.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:21.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:21.936 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:21.937 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:21.994 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:21.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:21.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:21.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:22.922 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:22.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:22.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:23.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:23.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:23.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:23.072 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:23.082 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:23.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:23.090 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:23.090 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:23.147 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:23.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:23.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:23.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:23.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:23.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:23.160 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:23.217 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:23.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:23.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:23.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:24.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:24.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:24.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:24.247 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:24.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:24.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:24.300 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:24.310 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:24.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:24.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:24.317 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:24.374 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:24.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:24.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:24.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:24.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:24.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:24.385 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:24.441 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:24.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:24.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:24.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:25.375 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:25.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:25.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:25.473 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:25.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:25.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:25.526 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:25.535 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:25.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:25.544 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:25.544 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:25.601 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:25.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:25.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:25.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:25.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:25.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:25.609 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:25.665 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:25.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:25.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:25.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:26.602 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:26.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:26.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:26.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:26.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:26.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:26.753 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:26.763 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:26.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:26.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:26.770 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:26.828 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:26.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:26.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:26.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:26.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:26.849 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:26.849 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:26.906 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:26.906 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:26.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:26.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:27.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:27.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:27.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:27.928 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:27.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:27.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:27.980 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:27.990 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:27.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:27.996 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:27.996 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:28.052 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:28.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:28.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:28.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:28.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:28.063 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:28.063 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:28.119 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:28.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:28.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:28.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:29.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:29.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:29.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:29.152 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:29.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:29.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:29.209 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:29.219 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:29.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:29.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:29.227 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:29.283 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:29.284 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:29.284 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:29.284 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:29.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:29.300 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:29.300 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:29.357 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:29.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:29.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:29.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:30.284 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:30.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:30.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:30.383 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:30.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:30.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:30.435 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:30.445 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:30.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:30.453 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:30.453 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:30.510 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:30.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:30.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:30.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:30.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:30.525 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:30.525 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:30.582 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:30.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:30.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:30.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:31.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:31.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:31.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:31.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:31.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:31.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:31.661 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:31.671 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:31.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:31.678 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:31.678 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:31.735 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:31.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:31.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:31.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:31.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:31.747 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:31.747 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:31.805 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:31.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:31.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:31.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:32.736 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:32.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:32.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:32.836 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:32.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:32.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:32.888 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:32.898 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:32.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:32.906 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:32.906 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:32.963 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:32.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:32.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:32.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:32.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:32.978 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:32.978 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:33.035 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:33.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:33.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:33.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:33.965 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:33.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:33.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:34.063 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:34.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:34.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:34.115 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:34.125 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:34.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:34.133 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:34.133 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:34.190 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:34.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:34.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:34.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:34.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:34.215 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:34.215 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:34.273 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:34.280 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:34.280 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:34.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:35.191 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:35.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:35.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:35.289 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:35.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:35.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:35.342 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:35.352 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:35.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:35.360 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:35.360 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:35.415 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:35.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:35.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:35.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:35.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:35.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:35.432 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:35.488 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:35.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:35.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:35.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:36.417 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:36.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:36.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:36.516 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:36.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:36.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:36.567 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:36.577 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:36.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:36.585 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:36.585 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:36.642 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:36.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:36.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:36.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:36.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:36.653 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:36.653 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:36.710 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:36.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:36.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:36.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:37.643 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:37.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:37.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:37.743 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:37.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:37.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:37.795 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:37.805 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:37.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:37.813 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:37.813 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:37.871 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:37.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:37.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:37.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:37.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:37.893 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:37.893 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:37.950 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:37.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:37.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:37.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:38.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:38.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:38.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:38.969 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:38.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:38.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:39.021 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:39.031 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:39.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:39.039 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:39.039 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:39.095 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:39.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:39.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:39.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:39.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:39.113 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:39.113 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:39.170 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:39.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:39.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:39.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:40.096 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:40.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:40.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:40.194 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:40.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:40.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:40.246 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:40.256 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:40.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:40.264 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:40.264 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:40.321 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:40.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:40.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:40.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:40.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:40.328 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:40.329 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:40.386 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:40.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:40.387 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:40.387 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:41.322 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:41.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:41.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:41.419 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:41.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:41.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:41.470 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:41.480 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:41.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:41.488 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:41.488 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:41.545 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:41.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:41.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:41.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:41.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:41.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:41.554 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:41.611 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:41.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:41.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:41.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:42.546 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:42.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:42.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:42.645 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:42.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:42.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:42.698 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:42.707 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:42.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:42.715 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:42.715 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:42.771 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:42.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:42.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:42.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:42.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:42.784 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:42.784 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:42.841 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:42.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:42.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:42.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:43.772 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:43.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:43.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:43.871 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:43.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:43.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:43.923 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:43.933 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:43.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:43.940 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:43.940 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:43.997 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:43.997 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:43.997 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:43.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:44.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:44.007 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:44.007 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:44.064 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:44.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:44.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:44.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:44.998 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:44.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:44.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:45.097 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:45.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:45.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:45.149 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:45.159 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:45.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:45.166 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:45.166 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:45.223 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:45.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:45.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:45.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:45.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:45.232 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:45.232 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:45.290 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:45.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:45.290 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:45.290 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:46.224 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:46.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:46.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:46.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:46.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:46.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:46.369 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:46.379 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:46.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:46.387 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:46.387 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:46.444 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:46.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:46.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:46.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:46.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:46.462 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:46.462 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:46.518 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:46.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:46.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:46.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:47.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:47.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:47.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:47.545 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:47.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:47.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:47.597 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:47.607 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:47.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:47.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:47.615 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:47.672 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:47.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:47.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:47.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:47.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:47.691 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:47.692 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:47.749 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:47.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:47.750 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:47.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:48.673 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:48.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:48.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:48.772 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:48.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:48.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:48.825 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:48.835 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:48.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:48.843 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:48.843 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:48.900 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:48.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:48.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:48.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:48.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:48.916 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:48.916 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:48.973 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:48.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:48.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:48.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:49.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:49.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:49.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:50.000 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:50.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:50.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:50.053 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:50.063 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:50.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:50.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:50.071 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:50.128 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:50.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:50.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:50.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:50.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:50.145 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:50.145 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:50.202 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:50.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:50.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:50.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:51.131 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:51.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:51.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:51.229 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:51.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:51.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:51.282 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:51.292 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:51.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:51.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:51.300 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:51.357 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:51.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:51.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:51.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:51.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:51.364 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:51.365 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:51.422 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:51.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:51.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:51.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:52.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:52.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:52.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:52.455 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:52.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:52.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:52.506 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:52.516 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:52.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:52.524 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:52.524 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:52.581 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:52.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:52.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:52.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:52.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:52.600 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:52.600 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:52.657 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:52.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:52.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:52.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:53.582 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:53.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:53.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:53.682 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:53.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:53.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:53.734 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:53.744 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:53.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:53.751 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:53.751 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:53.808 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:53.808 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:53.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:53.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:53.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:53.820 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:53.820 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:53.878 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:53.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:53.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:53.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:54.809 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:54.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:54.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:54.907 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:54.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:54.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:54.959 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:54.969 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:54.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:54.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:54.977 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:55.034 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:55.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:55.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:55.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:55.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:55.055 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:55.055 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:55.112 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:55.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:55.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:55.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:56.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:56.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:56.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:56.134 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:56.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:56.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:56.192 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:56.201 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:56.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:56.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:56.210 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:56.267 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:56.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:56.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:56.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:56.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:56.284 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:56.284 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:56.341 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:56.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:56.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:56.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:57.268 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:57.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:57.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:57.368 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:57.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:57.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:57.419 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:57.429 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:57.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:57.437 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:57.437 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:57.494 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:57.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:57.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:57.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:57.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:57.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:57.512 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:57.569 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:57.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:57.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:57.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:58.496 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:58.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:58.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:58.578 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:58.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:58.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:58.630 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:58.640 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:58.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:58.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:58.648 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:58.705 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:58.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:58.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:58.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:58.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:58.713 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:58.713 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:58.770 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:58.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:58.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:58.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:59.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:42:59.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:59.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:59.803 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:42:59.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:59.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:42:59.856 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:42:59.866 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:42:59.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:42:59.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:59.873 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:42:59.930 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:59.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:59.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:59.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:42:59.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:42:59.942 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:42:59.942 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:42:59.999 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:42:59.999 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:42:59.999 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:42:59.999 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:00.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:00.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:00.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:01.029 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:01.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:01.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:01.081 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:01.091 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:01.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:01.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:01.099 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:01.155 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:01.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:01.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:01.156 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:01.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:01.170 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:01.171 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:01.228 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:01.228 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:01.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:01.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:02.157 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:02.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:02.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:02.256 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:02.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:02.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:02.308 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:02.318 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:02.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:02.325 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:02.325 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:02.382 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:02.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:02.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:02.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:02.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:02.395 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:02.395 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:02.452 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:02.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:02.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:02.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:03.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:03.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:03.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:03.481 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:03.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:03.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:03.533 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:03.543 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:03.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:03.551 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:03.551 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:03.608 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:03.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:03.609 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:03.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:03.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:03.618 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:03.618 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:03.675 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:03.675 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:03.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:03.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:04.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:04.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:04.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:04.707 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:04.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:04.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:04.760 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:04.770 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:04.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:04.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:04.778 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:04.835 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:04.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:04.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:04.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:04.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:04.845 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:04.845 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:04.902 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:04.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:04.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:04.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:05.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:05.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:05.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:05.935 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:05.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:05.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:05.987 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:05.997 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:06.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:06.005 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:06.005 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:06.062 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:06.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:06.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:06.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:06.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:06.083 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:06.083 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:06.141 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:06.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:06.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:06.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:07.063 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:07.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:07.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:07.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:07.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:07.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:07.214 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:07.224 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:07.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:07.231 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:07.231 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:07.288 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:07.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:07.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:07.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:07.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:07.305 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:07.305 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:07.363 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:07.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:07.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:07.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:08.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:08.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:08.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:08.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:08.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:08.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:08.441 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:08.451 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:08.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:08.458 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:08.458 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:08.515 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:08.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:08.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:08.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:08.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:08.542 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:08.542 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:08.599 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:08.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:08.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:08.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:09.516 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:09.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:09.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:09.615 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:09.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:09.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:09.667 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:09.677 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:09.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:09.684 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:09.685 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:09.742 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:09.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:09.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:09.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:09.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:09.762 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:09.762 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:09.820 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:09.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:09.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:09.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:10.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:10.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:10.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:10.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:10.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:10.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:10.894 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:10.904 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:10.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:10.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:10.911 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:10.968 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:10.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:10.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:10.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:10.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:10.986 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:10.986 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:11.043 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:11.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:11.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:11.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:11.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:11.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:11.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:12.067 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:12.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:12.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:12.119 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:12.129 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:12.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:12.137 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:12.137 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:12.194 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:12.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:12.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:12.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:12.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:12.204 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:12.204 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:12.261 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:12.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:12.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:12.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:13.194 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:13.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:13.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:13.293 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:13.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:13.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:13.345 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:13.355 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:13.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:13.362 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:13.362 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:13.420 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:13.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:13.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:13.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:13.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:13.446 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:13.446 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:13.503 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:13.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:13.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:13.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:14.421 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:14.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:14.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:14.520 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:14.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:14.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:14.572 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:14.582 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:14.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:14.589 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:14.590 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:14.646 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:14.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:14.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:14.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:14.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:14.656 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:14.656 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:14.713 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:14.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:14.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:14.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:15.647 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:15.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:15.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:15.746 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:15.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:15.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:15.799 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:15.809 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:15.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:15.817 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:15.817 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:15.874 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:15.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:15.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:15.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:15.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:15.892 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:15.893 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:15.951 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:15.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:15.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:15.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:16.875 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:16.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:16.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:16.975 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:16.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:16.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:17.028 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:17.037 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:17.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:17.045 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:17.045 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:17.102 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:17.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:17.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:17.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:17.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:17.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:17.112 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:17.169 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:17.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:17.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:17.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:18.103 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:18.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:18.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:18.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:18.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:18.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:18.252 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:18.262 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:18.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:18.269 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:18.270 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:18.327 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:18.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:18.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:18.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:18.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:18.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:18.354 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:18.411 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:18.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:18.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:18.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:19.327 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:19.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:19.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:19.426 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:19.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:19.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:19.482 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:19.493 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:19.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:19.500 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:19.500 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:19.557 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:19.557 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:19.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:19.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:19.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:19.581 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:19.581 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:19.638 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:19.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:19.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:19.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:20.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:20.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:20.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:20.657 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:20.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:20.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:20.709 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:20.719 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:20.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:20.727 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:20.727 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:20.784 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:20.784 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:20.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:20.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:20.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:20.801 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:20.801 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:20.858 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:20.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:20.859 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:20.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:21.785 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:21.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:21.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:21.885 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:21.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:21.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:21.937 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:21.947 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:21.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:21.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:21.955 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:22.011 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:22.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:22.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:22.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:22.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:22.028 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:22.028 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:22.085 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:22.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:22.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:22.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:23.012 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:23.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:23.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:23.112 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:23.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:23.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:23.164 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:23.174 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:23.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:23.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:23.181 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:23.238 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:23.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:23.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:23.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:23.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:23.255 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:23.255 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:23.312 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:23.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:23.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:23.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:24.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:24.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:24.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:24.339 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:24.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:24.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:24.392 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:24.402 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:24.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:24.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:24.409 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:24.466 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:24.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:24.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:24.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:24.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:24.475 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:24.475 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:24.532 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:24.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:24.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:24.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:25.467 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:25.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:25.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:25.548 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:25.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:25.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:25.600 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:25.610 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:25.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:25.618 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:25.618 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:25.675 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:25.675 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:25.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:25.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:25.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:25.698 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:25.698 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:25.754 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:25.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:25.755 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:25.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:26.676 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:26.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:26.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:26.776 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:26.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:26.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:26.829 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:26.839 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:26.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:26.846 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:26.846 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:26.902 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:26.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:26.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:26.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:26.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:26.920 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:26.920 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:26.977 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:26.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:26.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:26.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:27.903 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:27.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:27.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:28.003 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:28.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:28.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:28.055 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:28.065 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:28.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:28.073 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:28.073 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:28.130 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:28.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:28.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:28.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:28.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:28.146 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:28.146 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:28.203 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:28.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:28.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:28.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:29.130 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:29.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:29.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:29.228 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:29.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:29.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:29.280 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:29.290 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:29.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:29.297 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:29.297 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:29.353 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:29.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:29.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:29.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:29.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:29.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:29.366 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:29.422 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:29.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:29.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:29.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:30.354 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:30.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:30.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:30.452 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:30.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:30.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:30.504 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:30.514 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:30.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:30.522 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:30.522 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:30.579 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:30.579 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:30.579 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:30.579 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:30.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:30.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:30.590 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:30.647 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:30.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:30.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:30.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:31.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:31.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:31.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:31.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:31.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:31.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:31.650 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:31.713 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:31.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:31.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:31.736 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:31.793 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:31.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:31.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:31.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:31.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:31.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:31.794 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:31.852 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:31.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:31.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:31.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:32.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:32.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:32.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:32.853 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:32.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:32.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:32.855 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:32.915 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:32.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:32.945 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:32.945 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:32.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:32.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:32.998 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:33.002 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:33.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:33.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:33.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:33.055 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:33.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:33.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:33.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:34.004 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:34.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:34.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:34.060 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:34.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:34.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:34.111 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:34.121 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:34.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:34.128 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:34.128 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:34.186 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:34.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:34.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:34.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:34.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:34.192 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:34.192 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:34.250 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:34.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:34.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:34.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:35.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:35.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:35.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:35.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:35.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:35.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:35.313 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:35.323 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:35.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:35.372 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:35.372 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:35.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:35.393 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:35.393 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:35.429 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:35.429 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:35.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:35.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:35.449 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:35.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:35.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:35.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:36.431 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:36.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:36.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:36.530 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:36.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:36.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:36.583 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:36.593 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:36.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:36.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:36.601 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:36.658 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:36.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:36.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:36.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:36.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:36.668 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:36.668 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:36.725 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:36.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:36.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:36.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:37.659 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:37.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:37.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:37.754 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:37.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:37.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:37.805 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:37.815 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:37.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:37.863 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:37.864 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:37.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:37.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:37.902 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:37.920 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:37.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:37.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:37.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:37.960 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:37.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:37.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:37.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:38.921 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:38.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:38.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:39.021 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:39.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:39.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:39.074 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:39.084 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:39.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:39.092 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:39.092 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:39.149 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:39.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:39.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:39.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:39.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:39.166 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:39.166 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:39.223 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:39.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:39.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:39.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:40.150 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:40.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:40.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:40.248 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:40.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:40.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:40.300 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:40.310 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:40.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:40.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:40.317 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:40.374 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:40.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:40.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:40.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:40.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:40.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:40.381 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:40.438 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:40.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:40.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:40.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:41.375 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:41.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:41.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:41.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:41.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:41.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:41.526 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:41.536 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:41.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:41.543 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:41.543 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:41.599 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:41.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:41.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:41.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:41.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:41.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:41.623 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:41.681 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:41.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:41.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:41.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:42.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:42.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:42.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:42.699 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:42.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:42.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:42.751 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:42.761 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:42.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:42.769 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:42.769 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:42.826 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:42.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:42.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:42.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:42.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:42.845 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:42.845 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:42.901 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:42.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:42.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:42.901 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:43.827 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:43.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:43.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:43.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:43.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:43.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:43.978 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:43.988 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:43.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:43.995 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:43.996 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:44.053 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:44.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:44.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:44.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:44.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:44.060 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:44.060 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:44.117 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:44.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:44.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:44.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:45.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:45.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:45.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:45.153 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:45.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:45.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:45.205 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:45.215 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:45.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:45.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:45.223 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:45.279 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:45.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:45.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:45.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:45.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:45.290 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:45.290 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:45.347 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:45.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:45.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:45.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:46.281 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:46.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:46.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:46.380 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:46.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:46.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:46.432 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:46.442 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:46.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:46.450 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:46.450 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:46.507 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:46.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:46.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:46.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:46.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:46.518 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:46.518 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:46.575 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:46.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:46.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:46.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:47.508 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:47.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:47.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:47.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:47.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:47.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:47.581 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:47.638 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:47.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:47.661 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:47.661 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:47.719 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:47.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:47.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:47.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:47.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:47.720 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:47.720 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:47.779 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:47.779 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:47.779 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:47.779 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:48.720 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:48.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:48.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:48.818 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:48.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:48.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:48.869 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:48.879 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:48.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:48.887 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:48.887 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:48.944 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:48.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:48.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:48.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:48.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:48.953 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:48.954 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:49.011 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:49.011 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:49.011 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:49.011 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:49.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:49.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:49.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:50.022 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:50.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:50.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:50.073 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:50.083 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:50.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:50.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:50.091 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:50.148 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:50.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:50.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:50.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:50.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:50.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:50.160 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:50.216 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:50.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:50.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:50.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:51.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:51.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:51.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:51.249 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:51.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:51.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:51.301 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:51.311 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:51.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:51.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:51.319 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:51.376 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:51.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:51.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:51.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:51.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:51.387 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:51.387 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:51.444 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:51.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:51.445 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:51.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:52.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:52.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:52.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:52.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:52.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:52.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:52.526 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:52.536 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:52.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:52.544 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:52.544 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:52.601 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:52.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:52.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:52.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:52.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:52.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:52.616 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:52.673 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:52.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:52.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:52.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:53.603 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:53.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:53.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:53.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:53.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:53.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:53.775 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:53.785 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:53.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:53.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:53.793 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:53.850 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:53.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:53.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:53.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:53.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:53.859 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:53.859 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:53.915 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:53.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:53.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:53.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:54.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:54.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:54.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:54.950 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:54.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:54.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:55.002 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:55.012 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:55.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:55.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:55.019 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:55.076 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:55.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:55.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:55.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:55.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:55.087 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:55.087 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:55.144 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:55.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:55.145 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:55.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:56.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:56.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:56.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:56.176 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:56.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:56.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:56.229 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:56.239 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:56.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:56.246 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:56.247 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:56.304 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:56.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:56.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:56.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:56.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:56.316 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:56.316 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:56.373 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:56.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:56.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:56.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:57.305 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:57.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:57.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:57.392 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:57.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:57.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:57.443 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:57.454 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:57.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:57.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:57.461 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:57.518 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:57.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:57.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:57.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:57.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:57.530 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:57.531 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:57.588 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:57.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:57.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:57.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:58.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:58.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:58.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:58.595 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:58.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:58.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:58.659 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:58.670 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:58.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:58.677 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:58.677 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:58.734 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:58.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:58.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:58.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:58.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:58.744 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:58.744 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:43:58.801 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:58.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:58.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:58.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:59.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:43:59.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:59.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:59.794 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:43:59.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:43:59.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:59.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:43:59.863 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:43:59.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:43:59.880 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:59.880 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:43:59.936 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:43:59.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:43:59.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:43:59.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:43:59.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:43:59.952 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:43:59.952 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:00.009 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:00.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:00.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:00.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:00.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:00.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:00.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:00.997 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:01.010 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:01.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:01.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:01.070 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:01.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:01.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:01.078 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:01.136 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:01.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:01.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:01.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:01.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:01.142 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:01.143 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:01.200 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:01.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:01.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:01.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:02.137 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:02.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:02.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:02.236 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:02.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:02.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:02.288 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:02.298 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:02.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:02.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:02.306 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:02.362 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:02.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:02.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:02.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:02.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:02.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:02.381 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:02.438 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:02.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:02.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:02.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:03.363 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:03.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:03.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:03.461 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:03.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:03.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:03.527 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:03.538 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:03.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:03.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:03.546 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:03.602 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:03.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:03.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:03.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:03.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:03.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:03.608 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:03.665 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:03.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:03.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:03.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:04.603 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:04.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:04.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:04.701 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:04.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:04.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:04.780 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:04.790 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:04.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:04.798 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:04.798 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:04.855 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:04.856 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:04.856 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:04.856 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:04.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:04.871 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:04.871 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:04.927 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:04.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:04.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:04.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:05.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:05.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:05.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:05.921 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:05.929 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:05.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:05.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:05.992 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:06.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:06.007 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:06.007 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:06.063 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:06.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:06.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:06.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:06.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:06.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:06.073 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:06.131 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:06.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:06.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:06.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:07.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:07.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:07.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:07.123 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:07.132 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:07.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:07.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:07.192 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:07.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:07.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:07.200 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:07.257 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:07.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:07.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:07.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:07.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:07.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:07.278 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:07.335 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:07.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:07.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:07.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:08.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:08.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:08.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:08.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:08.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:08.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:08.410 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:08.419 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:08.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:08.427 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:08.427 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:08.484 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:08.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:08.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:08.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:08.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:08.492 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:08.492 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:08.549 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:08.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:08.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:08.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:09.485 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:09.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:09.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:09.584 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:09.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:09.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:09.636 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:09.646 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:09.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:09.654 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:09.654 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:09.710 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:09.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:09.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:09.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:09.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:09.731 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:09.732 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:09.790 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:09.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:09.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:09.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:10.712 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:10.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:10.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:10.812 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:10.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:10.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:10.865 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:10.875 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:10.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:10.882 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:10.882 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:10.940 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:10.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:10.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:10.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:10.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:10.964 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:10.964 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:11.022 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:11.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:11.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:11.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:11.940 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:11.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:11.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:12.040 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:12.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:12.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:12.092 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:12.102 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:12.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:12.111 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:12.111 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:12.168 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:12.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:12.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:12.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:12.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:12.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:12.189 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:12.245 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:12.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:12.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:12.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:13.169 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:13.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:13.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:13.254 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:13.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:13.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:13.306 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:13.316 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:13.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:13.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:13.323 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:13.381 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:13.381 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:13.381 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:13.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:13.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:13.391 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:13.391 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:13.449 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:13.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:13.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:13.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:14.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:14.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:14.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:14.482 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:14.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:14.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:14.534 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:14.544 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:14.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:14.551 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:14.551 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:14.608 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:14.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:14.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:14.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:14.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:14.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:14.623 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:14.679 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:14.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:14.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:14.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:15.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:15.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:15.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:15.707 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:15.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:15.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:15.760 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:15.769 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:15.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:15.777 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:15.777 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:15.834 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:15.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:15.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:15.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:15.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:15.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:15.851 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:15.908 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:15.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:15.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:15.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:16.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:16.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:16.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:16.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:16.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:16.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:16.946 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:16.999 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:17.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:17.029 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:17.029 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:17.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:17.072 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:17.072 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:17.086 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:17.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:17.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:17.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:17.129 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:17.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:17.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:17.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:18.086 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:18.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:18.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:18.187 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:18.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:18.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:18.240 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:18.249 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:18.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:18.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:18.257 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:18.315 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:18.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:18.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:18.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:18.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:18.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:18.330 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:18.386 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:18.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:18.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:18.387 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:19.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:19.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:19.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:19.417 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:19.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:19.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:19.470 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:19.480 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:19.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:19.488 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:19.488 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:19.544 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:19.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:19.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:19.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:19.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:19.557 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:19.558 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:19.615 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:19.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:19.615 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:19.615 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:20.545 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:20.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:20.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:20.643 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:20.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:20.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:20.712 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:20.722 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:20.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:20.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:20.729 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:20.786 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:20.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:20.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:20.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:20.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:20.807 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:20.807 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:20.863 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:20.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:20.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:20.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:21.787 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:21.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:21.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:21.887 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:21.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:21.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:21.939 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:21.949 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:21.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:21.956 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:21.956 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:22.012 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:22.013 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:22.013 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:22.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:22.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:22.027 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:22.027 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:22.085 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:22.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:22.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:22.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:23.013 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:23.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:23.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:23.111 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:23.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:23.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:23.163 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:23.173 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:23.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:23.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:23.181 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:23.238 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:23.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:23.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:23.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:23.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:23.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:23.248 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:23.305 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:23.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:23.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:23.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:24.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:24.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:24.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:24.337 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:24.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:24.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:24.389 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:24.399 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:24.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:24.406 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:24.406 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:24.462 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:24.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:24.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:24.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:24.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:24.488 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:24.488 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:24.545 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:24.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:24.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:24.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:25.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:25.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:25.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:25.560 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:25.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:25.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:25.612 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:25.622 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:25.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:25.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:25.629 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:25.686 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:25.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:25.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:25.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:25.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:25.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:25.705 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:25.762 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:25.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:25.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:25.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:26.687 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:26.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:26.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:26.786 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:26.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:26.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:26.838 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:26.848 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:26.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:26.855 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:26.855 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:26.912 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:26.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:26.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:26.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:26.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:26.929 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:26.929 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:26.986 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:26.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:26.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:26.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:27.914 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:27.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:27.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:28.012 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:28.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:28.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:28.064 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:28.074 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:28.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:28.082 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:28.082 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:28.138 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:28.139 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:28.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:28.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:28.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:28.146 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:28.146 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:28.204 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:28.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:28.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:28.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:29.140 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:29.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:29.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:29.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:29.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:29.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:29.291 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:29.301 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:29.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:29.309 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:29.309 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:29.366 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:29.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:29.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:29.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:29.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:29.376 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:29.376 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:29.433 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:29.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:29.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:29.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:30.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:30.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:30.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:30.467 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:30.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:30.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:30.520 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:30.530 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:30.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:30.537 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:30.537 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:30.594 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:30.595 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:30.595 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:30.595 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:30.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:30.620 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:30.621 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:30.677 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:30.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:30.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:30.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:31.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:31.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:31.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:31.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:31.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:31.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:31.747 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:31.757 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:31.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:31.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:31.766 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:31.822 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:31.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:31.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:31.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:31.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:31.833 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:31.833 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:31.890 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:31.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:31.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:31.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:32.824 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:32.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:32.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:32.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:32.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:32.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:32.978 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:32.987 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:32.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:32.995 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:32.995 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:33.051 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:33.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:33.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:33.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:33.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:33.072 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:33.072 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:33.130 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:33.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:33.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:33.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:34.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:34.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:34.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:34.152 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:34.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:34.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:34.203 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:34.213 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:34.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:34.221 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:34.221 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:34.277 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:34.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:34.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:34.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:34.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:34.300 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:34.301 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:34.357 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:34.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:34.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:34.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:35.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:35.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:35.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:35.381 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:35.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:35.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:35.434 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:35.443 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:35.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:35.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:35.451 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:35.508 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:35.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:35.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:35.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:35.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:35.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:35.516 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:35.573 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:35.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:35.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:35.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:36.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:36.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:36.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:36.608 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:36.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:36.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:36.661 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:36.671 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:36.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:36.678 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:36.678 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:36.734 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:36.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:36.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:36.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:36.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:36.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:36.745 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:36.803 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:36.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:36.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:36.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:37.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:37.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:37.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:37.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:37.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:37.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:37.886 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:37.896 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:37.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:37.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:37.904 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:37.961 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:37.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:37.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:37.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:37.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:37.972 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:37.972 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:38.029 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:38.030 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:38.030 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:38.030 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:38.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:38.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:38.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:39.061 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:39.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:39.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:39.114 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:39.124 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:39.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:39.131 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:39.132 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:39.188 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:39.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:39.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:39.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:39.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:39.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:39.195 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:39.252 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:39.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:39.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:39.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:40.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:40.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:40.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:40.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:40.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:40.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:40.340 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:40.350 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:40.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:40.357 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:40.357 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:40.414 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:40.415 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:40.415 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:40.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:40.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:40.429 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:40.429 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:40.486 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:40.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:40.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:40.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:41.416 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:41.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:41.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:41.516 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:41.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:41.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:41.567 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:41.578 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:41.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:41.585 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:41.585 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:41.642 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:41.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:41.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:41.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:41.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:41.655 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:41.655 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:41.713 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:41.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:41.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:41.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:42.644 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:42.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:42.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:42.743 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:42.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:42.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:42.796 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:42.806 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:42.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:42.813 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:42.813 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:42.870 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:42.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:42.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:42.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:42.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:42.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:42.880 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:42.939 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:42.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:42.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:42.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:43.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:43.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:43.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:43.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:43.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:43.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:44.023 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:44.032 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:44.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:44.040 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:44.040 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:44.097 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:44.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:44.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:44.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:44.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:44.106 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:44.106 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:44.163 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:44.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:44.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:44.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:45.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:45.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:45.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:45.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:45.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:45.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:45.249 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:45.259 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:45.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:45.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:45.267 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:45.324 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:45.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:45.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:45.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:45.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:45.337 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:45.337 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:45.394 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:45.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:45.395 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:45.395 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:46.326 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:46.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:46.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:46.424 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:46.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:46.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:46.477 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:46.486 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:46.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:46.494 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:46.494 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:46.550 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:46.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:46.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:46.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:46.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:46.571 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:46.572 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:46.628 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:46.628 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:46.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:46.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:47.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:47.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:47.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:47.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:47.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:47.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:47.703 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:47.713 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:47.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:47.720 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:47.720 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:47.778 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:47.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:47.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:47.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:47.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:47.800 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:47.800 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:47.857 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:47.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:47.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:47.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:48.779 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:48.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:48.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:48.878 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:48.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:48.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:48.928 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:48.938 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:48.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:48.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:48.946 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:49.003 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:49.003 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:49.003 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:49.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:49.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:49.022 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:49.022 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:49.079 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:49.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:49.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:49.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:50.004 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:50.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:50.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:50.102 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:50.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:50.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:50.154 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:50.164 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:50.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:50.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:50.172 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:50.228 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:50.228 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:50.228 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:50.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:50.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:50.241 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:50.241 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:50.298 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:50.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:50.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:50.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:51.229 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:51.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:51.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:51.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:51.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:51.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:51.379 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:51.389 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:51.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:51.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:51.396 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:51.452 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:51.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:51.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:51.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:51.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:51.473 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:51.473 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:51.530 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:51.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:51.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:51.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:52.454 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:52.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:52.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:52.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:52.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:52.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:52.602 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:52.612 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:52.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:52.619 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:52.619 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:52.676 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:52.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:52.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:52.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:52.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:52.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:52.688 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:52.745 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:52.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:52.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:52.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:53.678 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:53.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:53.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:53.776 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:53.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:53.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:53.828 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:53.838 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:53.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:53.846 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:53.846 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:53.903 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:53.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:53.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:53.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:53.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:53.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:53.912 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:53.969 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:53.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:53.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:53.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:54.904 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:54.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:54.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:55.004 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:55.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:55.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:55.057 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:55.067 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:55.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:55.074 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:55.074 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:55.130 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:55.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:55.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:55.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:55.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:55.143 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:55.143 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:55.200 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:55.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:55.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:55.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:56.131 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:56.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:56.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:56.231 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:56.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:56.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:56.282 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:56.292 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:56.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:56.299 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:56.299 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:56.356 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:56.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:56.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:56.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:56.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:56.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:56.366 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:56.423 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:56.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:56.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:56.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:57.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:57.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:57.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:57.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:57.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:57.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:57.512 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:57.522 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:57.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:57.530 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:57.530 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:57.587 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:57.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:57.587 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:57.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:57.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:57.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:57.598 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:57.655 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:57.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:57.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:57.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:58.588 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:58.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:58.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:58.670 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:58.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:58.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:58.728 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:58.738 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:58.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:58.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:58.745 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:44:58.803 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:58.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:58.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:58.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:58.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:58.827 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:58.827 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:44:58.884 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:44:58.885 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:44:58.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:44:58.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:44:59.804 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:44:59.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:59.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:59.911 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:44:59.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:44:59.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:44:59.964 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:44:59.974 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:44:59.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:44:59.981 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:44:59.981 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:00.038 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:00.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:00.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:00.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:00.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:00.053 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:00.053 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:00.110 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:00.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:00.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:00.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:01.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:01.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:01.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:01.141 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:01.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:01.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:01.193 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:01.203 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:01.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:01.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:01.210 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:01.268 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:01.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:01.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:01.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:01.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:01.286 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:01.286 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:01.343 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:01.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:01.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:01.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:02.269 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:02.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:02.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:02.367 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:02.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:02.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:02.418 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:02.428 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:02.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:02.435 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:02.436 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:02.492 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:02.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:02.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:02.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:02.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:02.511 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:02.512 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:02.568 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:02.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:02.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:02.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:03.493 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:03.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:03.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:03.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:03.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:03.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:03.643 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:03.653 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:03.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:03.661 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:03.661 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:03.717 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:03.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:03.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:03.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:03.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:03.730 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:03.730 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:03.787 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:03.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:03.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:03.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:04.719 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:04.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:04.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:04.817 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:04.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:04.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:04.869 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:04.879 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:04.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:04.887 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:04.887 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:04.944 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:04.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:04.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:04.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:04.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:04.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:04.961 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:05.018 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:05.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:05.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:05.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:05.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:05.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:05.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:06.044 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:06.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:06.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:06.096 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:06.106 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:06.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:06.113 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:06.113 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:06.169 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:06.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:06.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:06.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:06.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:06.181 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:06.181 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:06.239 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:06.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:06.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:06.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:07.171 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:07.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:07.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:07.270 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:07.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:07.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:07.321 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:07.331 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:07.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:07.339 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:07.339 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:07.396 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:07.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:07.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:07.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:07.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:07.413 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:07.414 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:07.470 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:07.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:07.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:07.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:08.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:08.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:08.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:08.497 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:08.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:08.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:08.549 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:08.559 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:08.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:08.567 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:08.567 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:08.624 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:08.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:08.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:08.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:08.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:08.635 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:08.635 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:08.693 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:08.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:08.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:08.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:09.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:09.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:09.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:09.720 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:09.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:09.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:09.772 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:09.782 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:09.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:09.789 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:09.789 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:09.845 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:09.845 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:09.845 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:09.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:09.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:09.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:09.858 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:09.915 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:09.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:09.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:09.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:10.846 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:10.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:10.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:10.946 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:10.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:10.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:10.998 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:11.008 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:11.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:11.015 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:11.015 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:11.072 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:11.072 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:11.072 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:11.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:11.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:11.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:11.091 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:11.148 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:11.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:11.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:11.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:12.073 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:12.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:12.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:12.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:12.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:12.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:12.225 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:12.234 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:12.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:12.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:12.242 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:12.299 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:12.299 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:12.299 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:12.299 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:12.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:12.312 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:12.312 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:12.369 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:12.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:12.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:12.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:13.300 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:13.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:13.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:13.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:13.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:13.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:13.450 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:13.460 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:13.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:13.467 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:13.467 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:13.523 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:13.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:13.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:13.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:13.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:13.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:13.534 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:13.595 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:13.595 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:13.595 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:13.595 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:14.525 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:14.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:14.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:14.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:14.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:14.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:14.673 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:14.683 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:14.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:14.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:14.690 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:14.748 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:14.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:14.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:14.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:14.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:14.751 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:14.751 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:14.808 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:14.809 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:14.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:14.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:15.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:15.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:15.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:15.850 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:15.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:15.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:15.901 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:15.911 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:15.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:15.919 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:15.920 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:15.976 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:15.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:15.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:15.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:15.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:15.994 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:15.994 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:16.051 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:16.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:16.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:16.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:16.977 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:16.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:16.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:17.076 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:17.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:17.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:17.128 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:17.138 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:17.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:17.145 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:17.145 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:17.201 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:17.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:17.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:17.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:17.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:17.214 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:17.214 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:17.271 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:17.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:17.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:17.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:18.202 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:18.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:18.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:18.300 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:18.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:18.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:18.352 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:18.362 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:18.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:18.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:18.370 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:18.428 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:18.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:18.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:18.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:18.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:18.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:18.438 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:18.495 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:18.496 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:18.496 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:18.496 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:19.429 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:19.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:19.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:19.527 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:19.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:19.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:19.579 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:19.589 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:19.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:19.597 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:19.597 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:19.653 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:19.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:19.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:19.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:19.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:19.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:19.662 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:19.719 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:19.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:19.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:19.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:20.655 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:20.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:20.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:20.754 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:20.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:20.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:20.807 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:20.817 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:20.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:20.824 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:20.824 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:20.881 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:20.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:20.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:20.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:20.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:20.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:20.899 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:20.956 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:20.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:20.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:20.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:21.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:21.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:21.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:21.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:21.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:21.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:22.032 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:22.042 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:22.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:22.049 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:22.049 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:22.105 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:22.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:22.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:22.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:22.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:22.114 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:22.114 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:22.171 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:22.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:22.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:22.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:23.106 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:23.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:23.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:23.205 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:23.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:23.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:23.257 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:23.267 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:23.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:23.276 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:23.276 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:23.333 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:23.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:23.334 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:23.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:23.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:23.345 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:23.345 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:23.402 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:23.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:23.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:23.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:24.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:24.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:24.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:24.434 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:24.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:24.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:24.486 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:24.496 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:24.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:24.504 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:24.504 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:24.560 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:24.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:24.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:24.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:24.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:24.573 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:24.573 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:24.631 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:24.631 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:24.631 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:24.631 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:25.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:25.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:25.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:25.660 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:25.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:25.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:25.713 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:25.722 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:25.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:25.730 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:25.730 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:25.786 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:25.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:25.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:25.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:25.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:25.804 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:25.804 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:25.861 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:25.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:25.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:25.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:26.788 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:26.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:26.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:26.886 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:26.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:26.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:26.938 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:26.948 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:26.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:26.956 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:26.956 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:27.012 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:27.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:27.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:27.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:27.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:27.033 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:27.033 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:27.090 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:27.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:27.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:27.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:28.014 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:28.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:28.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:28.113 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:28.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:28.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:28.165 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:28.175 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:28.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:28.183 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:28.183 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:28.240 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:28.241 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:28.241 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:28.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:28.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:28.262 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:28.262 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:28.319 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:28.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:28.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:28.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:29.242 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:29.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:29.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:29.333 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:29.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:29.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:29.385 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:29.395 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:29.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:29.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:29.403 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:29.459 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:29.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:29.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:29.460 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:29.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:29.476 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:29.477 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:29.534 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:29.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:29.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:29.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:30.461 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:30.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:30.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:30.558 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:30.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:30.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:30.611 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:30.621 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:30.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:30.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:30.629 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:30.686 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:30.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:30.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:30.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:30.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:30.712 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:30.712 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:30.771 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:30.771 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:30.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:30.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:31.687 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:31.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:31.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:31.788 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:31.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:31.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:31.840 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:31.851 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:31.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:31.858 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:31.858 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:31.915 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:31.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:31.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:31.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:31.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:31.925 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:31.925 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:31.982 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:31.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:31.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:31.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:32.917 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:32.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:32.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:33.016 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:33.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:33.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:33.068 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:33.078 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:33.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:33.086 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:33.086 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:33.142 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:33.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:33.142 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:33.142 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:33.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:33.151 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:33.152 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:33.209 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:33.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:33.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:33.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:34.143 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:34.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:34.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:34.243 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:34.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:34.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:34.295 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:34.305 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:34.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:34.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:34.312 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:34.370 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:34.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:34.371 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:34.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:34.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:34.384 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:34.384 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:34.441 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:34.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:34.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:34.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:35.371 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:35.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:35.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:35.471 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:35.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:35.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:35.522 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:35.532 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:35.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:35.540 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:35.540 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:35.596 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:35.597 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:35.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:35.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:35.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:35.612 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:35.612 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:35.669 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:35.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:35.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:35.669 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:36.597 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:36.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:36.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:36.696 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:36.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:36.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:36.748 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:36.758 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:36.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:36.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:36.766 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:36.822 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:36.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:36.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:36.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:36.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:36.845 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:36.845 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:36.902 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:36.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:36.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:36.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:37.824 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:37.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:37.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:37.922 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:37.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:37.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:37.974 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:37.984 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:37.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:37.991 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:37.992 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:38.049 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:38.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:38.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:38.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:38.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:38.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:38.066 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:38.123 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:38.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:38.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:38.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:39.050 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:39.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:39.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:39.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:39.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:39.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:39.213 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:39.225 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:39.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:39.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:39.230 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:39.286 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:39.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:39.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:39.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:39.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:39.301 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:39.302 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:39.358 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:39.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:39.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:39.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:40.288 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:40.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:40.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:40.386 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:40.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:40.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:40.438 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:40.448 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:40.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:40.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:40.456 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:40.513 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:40.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:40.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:40.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:40.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:40.528 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:40.528 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:40.584 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:40.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:40.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:40.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:41.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:41.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:41.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:41.613 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:41.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:41.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:41.665 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:41.675 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:41.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:41.683 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:41.683 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:41.739 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:41.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:41.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:41.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:41.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:41.748 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:41.748 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:41.804 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:41.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:41.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:41.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:42.741 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:42.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:42.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:42.839 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:42.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:42.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:42.891 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:42.902 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:42.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:42.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:42.910 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:42.966 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:42.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:42.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:42.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:42.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:42.974 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:42.975 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:43.031 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:43.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:43.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:43.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:43.967 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:43.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:43.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:44.065 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:44.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:44.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:44.135 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:44.146 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:44.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:44.154 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:44.154 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:44.210 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:44.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:44.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:44.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:44.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:44.225 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:44.225 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:44.282 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:44.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:44.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:44.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:45.211 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:45.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:45.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:45.311 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:45.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:45.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:45.363 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:45.373 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:45.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:45.380 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:45.380 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:45.437 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:45.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:45.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:45.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:45.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:45.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:45.458 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:45.515 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:45.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:45.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:45.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:46.438 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:46.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:46.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:46.538 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:46.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:46.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:46.591 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:46.601 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:46.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:46.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:46.608 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:46.665 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:46.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:46.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:46.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:46.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:46.675 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:46.675 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:46.732 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:46.733 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:46.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:46.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:47.667 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:47.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:47.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:47.765 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:47.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:47.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:47.817 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:47.827 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:47.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:47.835 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:47.835 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:47.891 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:47.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:47.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:47.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:47.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:47.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:47.908 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:47.965 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:47.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:47.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:47.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:48.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:48.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:48.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:48.991 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:48.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:48.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:49.044 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:49.054 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:49.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:49.061 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:49.061 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:49.117 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:49.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:49.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:49.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:49.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:49.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:49.136 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:49.194 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:49.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:49.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:49.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:50.118 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:50.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:50.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:50.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:50.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:50.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:50.270 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:50.280 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:50.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:50.287 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:50.287 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:50.344 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:50.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:50.345 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:50.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:50.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:50.370 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:50.370 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:50.427 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:50.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:50.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:50.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:51.346 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:51.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:51.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:51.419 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:51.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:51.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:51.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:51.495 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:51.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:51.502 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:51.502 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:51.558 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:51.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:51.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:51.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:51.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:51.573 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:51.573 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:51.630 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:51.631 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:51.631 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:51.631 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:52.559 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:52.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:52.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:52.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:52.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:52.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:52.712 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:52.722 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:52.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:52.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:52.729 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:52.788 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:52.788 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:52.788 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:52.788 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:52.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:52.802 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:52.803 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:52.861 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:52.861 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:52.861 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:52.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:53.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:53.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:53.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:53.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:53.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:53.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:53.942 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:53.952 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:53.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:53.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:53.960 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:54.017 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:54.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:54.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:54.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:54.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:54.034 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:54.034 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:54.090 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:54.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:54.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:54.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:55.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:55.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:55.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:55.116 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:55.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:55.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:55.169 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:55.179 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:55.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:55.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:55.186 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:55.242 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:55.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:55.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:55.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:55.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:55.254 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:55.254 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:55.312 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:55.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:55.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:55.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:56.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:56.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:56.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:56.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:56.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:56.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:56.395 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:56.405 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:56.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:56.413 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:56.413 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:56.469 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:56.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:56.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:56.470 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:56.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:56.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:56.487 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:56.545 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:56.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:56.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:56.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:57.471 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:57.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:57.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:57.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:57.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:57.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:57.628 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:57.638 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:57.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:57.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:57.646 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:57.702 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:57.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:57.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:57.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:57.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:57.721 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:57.721 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:57.780 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:57.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:57.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:57.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:58.704 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:58.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:58.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:58.803 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:58.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:58.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:58.854 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:45:58.864 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:45:58.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:58.871 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:58.871 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:45:58.927 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:58.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:58.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:58.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:58.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:58.939 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:45:58.939 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:45:58.996 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:45:58.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:45:58.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:45:58.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:45:59.928 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:45:59.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:45:59.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:45:59.998 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:45:59.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:45:59.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:00.003 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:00.059 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:00.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:00.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:00.091 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:00.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:00.134 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:00.134 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:00.148 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:00.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:00.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:00.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:00.190 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:00.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:00.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:00.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:01.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:01.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:01.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:01.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:01.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:01.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:01.279 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:01.289 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:01.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:01.296 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:01.297 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:01.353 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:01.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:01.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:01.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:01.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:01.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:01.365 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:01.423 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:01.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:01.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:01.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:02.354 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:02.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:02.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:02.453 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:02.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:02.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:02.505 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:02.515 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:02.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:02.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:02.523 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:02.579 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:02.580 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:02.580 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:02.580 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:02.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:02.594 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:02.594 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:02.651 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:02.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:02.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:02.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:03.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:03.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:03.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:03.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:03.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:03.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:03.732 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:03.742 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:03.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:03.750 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:03.750 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:03.806 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:03.807 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:03.807 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:03.807 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:03.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:03.820 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:03.820 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:03.877 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:03.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:03.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:03.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:04.807 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:04.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:04.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:04.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:04.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:04.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:04.942 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:04.952 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:04.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:04.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:04.960 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:05.018 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:05.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:05.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:05.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:05.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:05.026 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:05.027 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:05.083 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:05.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:05.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:05.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:06.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:06.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:06.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:06.117 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:06.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:06.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:06.169 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:06.179 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:06.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:06.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:06.186 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:06.244 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:06.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:06.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:06.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:06.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:06.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:06.259 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:06.318 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:06.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:06.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:06.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:07.245 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:07.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:07.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:07.343 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:07.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:07.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:07.393 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:07.403 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:07.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:07.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:07.451 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:07.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:07.477 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:07.477 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:07.507 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:07.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:07.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:07.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:07.533 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:07.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:07.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:07.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:08.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:08.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:08.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:08.571 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:08.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:08.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:08.622 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:08.632 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:08.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:08.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:08.640 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:08.696 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:08.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:08.697 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:08.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:08.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:08.711 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:08.711 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:08.768 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:08.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:08.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:08.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:09.697 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:09.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:09.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:09.799 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:09.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:09.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:09.881 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:09.892 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:09.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:09.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:09.899 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:09.955 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:09.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:09.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:09.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:09.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:09.978 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:09.978 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:10.035 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:10.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:10.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:10.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:10.957 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:10.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:10.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:11.025 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:11.036 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:11.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:11.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:11.100 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:11.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:11.107 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:11.107 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:11.164 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:11.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:11.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:11.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:11.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:11.181 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:11.181 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:11.237 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:11.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:11.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:11.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:12.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:12.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:12.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:12.265 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:12.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:12.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:12.317 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:12.326 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:12.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:12.334 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:12.334 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:12.391 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:12.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:12.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:12.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:12.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:12.407 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:12.407 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:12.464 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:12.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:12.465 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:12.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:13.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:13.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:13.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:13.492 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:13.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:13.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:13.545 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:13.555 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:13.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:13.564 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:13.564 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:13.621 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:13.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:13.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:13.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:13.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:13.634 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:13.634 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:13.692 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:13.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:13.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:13.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:14.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:14.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:14.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:14.721 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:14.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:14.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:14.774 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:14.784 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:14.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:14.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:14.792 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:14.848 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:14.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:14.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:14.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:14.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:14.864 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:14.864 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:14.921 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:14.921 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:14.921 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:14.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:15.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:15.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:15.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:15.911 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:15.922 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:15.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:15.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:15.985 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:15.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:15.993 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:15.993 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:16.050 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:16.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:16.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:16.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:16.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:16.070 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:16.070 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:16.128 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:16.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:16.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:16.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:17.051 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:17.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:17.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:17.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:17.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:17.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:17.203 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:17.213 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:17.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:17.220 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:17.220 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:17.277 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:17.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:17.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:17.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:17.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:17.291 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:17.292 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:17.349 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:17.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:17.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:17.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:18.278 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:18.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:18.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:18.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:18.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:18.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:18.427 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:18.437 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:18.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:18.445 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:18.445 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:18.502 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:18.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:18.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:18.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:18.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:18.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:18.520 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:18.577 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:18.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:18.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:18.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:19.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:19.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:19.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:19.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:19.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:19.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:19.654 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:19.664 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:19.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:19.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:19.671 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:19.728 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:19.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:19.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:19.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:19.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:19.748 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:19.748 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:19.805 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:19.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:19.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:19.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:20.729 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:20.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:20.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:20.829 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:20.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:20.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:20.882 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:20.892 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:20.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:20.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:20.899 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:20.956 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:20.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:20.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:20.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:20.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:20.966 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:20.966 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:21.023 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:21.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:21.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:21.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:21.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:21.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:21.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:22.057 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:22.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:22.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:22.109 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:22.119 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:22.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:22.126 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:22.127 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:22.184 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:22.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:22.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:22.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:22.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:22.198 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:22.198 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:22.255 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:22.255 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:22.255 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:22.255 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:23.185 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:23.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:23.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:23.285 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:23.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:23.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:23.338 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:23.348 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:23.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:23.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:23.355 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:23.413 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:23.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:23.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:23.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:23.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:23.433 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:23.433 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:23.490 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:23.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:23.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:23.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:24.414 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:46:24.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:24.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:24.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:46:24.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:24.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:46:24.565 DEBUG:teuthology.orchestra.run.trial033:> true 2026-02-12T22:46:24.575 DEBUG:teuthology.orchestra.run.trial132:> true 2026-02-12T22:46:24.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial033.front.sepia.ceph.com' 2026-02-12T22:46:24.582 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:24.583 DEBUG:teuthology.orchestra.run.trial033:> uname -r 2026-02-12T22:46:24.639 INFO:teuthology.orchestra.run.trial033.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:24.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:24.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:24.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:24.640 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:24.640 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:46:24.652 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:46:24.684 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:46:24.684 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:46:24.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial132.front.sepia.ceph.com' 2026-02-12T22:46:24.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:46:24.688 DEBUG:teuthology.orchestra.run.trial132:> uname -r 2026-02-12T22:46:24.772 INFO:teuthology.orchestra.run.trial132.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:46:24.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:46:24.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:46:24.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:46:24.801 INFO:teuthology.run:FAIL