2026-02-12T22:47:13.247 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:47:13.263 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:47:13.362 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47299 branch: wip-pdonnell-testing-20260210.171210 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47299' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOy9Y70fOaiXYoDhOw6EnTjTYnjdjkt0z9SqbYmv4RgH+Avq0sspWHNOuPhlbvRLQ5mzq07NZPirKcxSwmLWals= trial111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOtXlFNU1ccY+DGMNyk0awV0/1rcdY9/lpPITyPTT0iR1ulTsZpCI9MPmRhv+OBWVX46Cu6YmfrvrUyR8AOm7wc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:47:13.362 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:47:13.362 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:47:13.362 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:47:13.365 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:47:13.365 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:47:13.365 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:47:13.365 INFO:teuthology.packaging:ref: None 2026-02-12T22:47:13.365 INFO:teuthology.packaging:tag: None 2026-02-12T22:47:13.365 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:47:13.365 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:47:13.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:47:13.489 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:47:13.490 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:47:13.502 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:47:13.502 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:47:13.515 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:47:13.532 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:47:13.544 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:47:13.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial046.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47299', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:43:42.748155', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOy9Y70fOaiXYoDhOw6EnTjTYnjdjkt0z9SqbYmv4RgH+Avq0sspWHNOuPhlbvRLQ5mzq07NZPirKcxSwmLWals='} 2026-02-12T22:47:13.677 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial111.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47299', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:43:42.748810', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOtXlFNU1ccY+DGMNyk0awV0/1rcdY9/lpPITyPTT0iR1ulTsZpCI9MPmRhv+OBWVX46Cu6YmfrvrUyR8AOm7wc='} 2026-02-12T22:47:13.677 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:47:13.689 INFO:teuthology.task.internal:roles: ubuntu@trial046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:47:13.689 INFO:teuthology.task.internal:roles: ubuntu@trial111.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-12T22:47:13.689 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:47:13.833 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7c80b6aa59e0>, signals=[15]) 2026-02-12T22:47:13.833 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:47:13.848 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:47:13.848 DEBUG:teuthology.task.internal:connecting to ubuntu@trial046.front.sepia.ceph.com 2026-02-12T22:47:13.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:13.911 DEBUG:teuthology.task.internal:connecting to ubuntu@trial111.front.sepia.ceph.com 2026-02-12T22:47:13.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:47:13.970 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:47:13.983 DEBUG:teuthology.orchestra.run.trial046:> uname -m 2026-02-12T22:47:14.000 INFO:teuthology.orchestra.run.trial046.stdout:x86_64 2026-02-12T22:47:14.000 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release 2026-02-12T22:47:14.056 INFO:teuthology.orchestra.run.trial046.stdout:NAME="Rocky Linux" 2026-02-12T22:47:14.056 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:47:14.056 INFO:teuthology.orchestra.run.trial046.stdout:ID="rocky" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="10.1" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;32" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:VENDOR_NAME="RESF" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:47:14.057 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:14.057 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server 2026-02-12T22:47:14.125 DEBUG:teuthology.orchestra.run.trial111:> uname -m 2026-02-12T22:47:14.142 INFO:teuthology.orchestra.run.trial111.stdout:x86_64 2026-02-12T22:47:14.142 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:NAME="Rocky Linux" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:ID="rocky" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="10.1" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;32" 2026-02-12T22:47:14.199 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_NAME="RESF" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:47:14.200 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:47:14.200 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-12T22:47:14.277 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:47:14.291 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:47:14.302 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:47:14.303 DEBUG:teuthology.orchestra.run.trial046:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:47:14.304 DEBUG:teuthology.orchestra.run.trial111:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:47:14.321 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:47:14.332 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:47:14.332 DEBUG:teuthology.orchestra.run.trial046:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:47:14.361 DEBUG:teuthology.orchestra.run.trial111:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:47:14.377 INFO:teuthology.orchestra.run.trial046.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:47:14.379 INFO:teuthology.orchestra.run.trial111.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:47:14.379 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:47:14.533 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:47:14.552 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:47:14.552 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:47:14.552 DEBUG:teuthology.orchestra.run.trial046:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:47:14.553 DEBUG:teuthology.orchestra.run.trial111:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:47:14.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:47:14.568 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:47:14.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:47:14.569 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:47:14.625 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:14.626 INFO:teuthology.task.kernel:Running kernel on trial046: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:14.626 DEBUG:teuthology.orchestra.run.trial046:> sudo yum install -y kernel 2026-02-12T22:47:14.627 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:14.627 INFO:teuthology.task.kernel:Running kernel on trial111: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:47:14.627 DEBUG:teuthology.orchestra.run.trial111:> sudo yum install -y kernel 2026-02-12T22:47:15.143 INFO:teuthology.orchestra.run.trial111.stdout:Rocky Linux 10 - AppStream 19 MB/s | 2.2 MB 00:00 2026-02-12T22:47:15.145 INFO:teuthology.orchestra.run.trial046.stdout:Rocky Linux 10 - AppStream 19 MB/s | 2.2 MB 00:00 2026-02-12T22:47:15.458 INFO:teuthology.orchestra.run.trial046.stdout:Rocky Linux 10 - BaseOS 58 MB/s | 11 MB 00:00 2026-02-12T22:47:15.493 INFO:teuthology.orchestra.run.trial111.stdout:Rocky Linux 10 - BaseOS 49 MB/s | 11 MB 00:00 2026-02-12T22:47:15.954 INFO:teuthology.orchestra.run.trial046.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 507 kB 00:00 2026-02-12T22:47:15.980 INFO:teuthology.orchestra.run.trial111.stdout:Rocky Linux 10 - CRB 6.2 MB/s | 507 kB 00:00 2026-02-12T22:47:16.365 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 18 MB/s | 6.2 MB 00:00 2026-02-12T22:47:16.368 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 17 MB/s | 6.2 MB 00:00 2026-02-12T22:47:17.026 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 170 kB/s | 3.7 kB 00:00 2026-02-12T22:47:17.027 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 172 kB/s | 3.7 kB 00:00 2026-02-12T22:47:17.435 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:47:17.436 INFO:teuthology.orchestra.run.trial111.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:47:17.446 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-12T22:47:17.447 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-12T22:47:17.447 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-12T22:47:17.448 INFO:teuthology.orchestra.run.trial046.stdout:Install 5 Packages 2026-02-12T22:47:17.449 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 93 M 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 135 M 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T22:47:17.450 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout:Install 5 Packages 2026-02-12T22:47:17.451 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T22:47:17.452 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 93 M 2026-02-12T22:47:17.452 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 135 M 2026-02-12T22:47:17.452 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T22:47:17.499 INFO:teuthology.orchestra.run.trial111.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 28 MB/s | 1.4 MB 00:00 2026-02-12T22:47:17.508 INFO:teuthology.orchestra.run.trial046.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2026-02-12T22:47:17.713 INFO:teuthology.orchestra.run.trial111.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 70 MB/s | 18 MB 00:00 2026-02-12T22:47:17.729 INFO:teuthology.orchestra.run.trial046.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 66 MB/s | 18 MB 00:00 2026-02-12T22:47:17.770 INFO:teuthology.orchestra.run.trial111.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 49 MB/s | 2.8 MB 00:00 2026-02-12T22:47:17.796 INFO:teuthology.orchestra.run.trial046.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 42 MB/s | 2.8 MB 00:00 2026-02-12T22:47:17.956 INFO:teuthology.orchestra.run.trial046.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 80 MB/s | 41 MB 00:00 2026-02-12T22:47:17.978 INFO:teuthology.orchestra.run.trial111.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 77 MB/s | 41 MB 00:00 2026-02-12T22:47:18.019 INFO:teuthology.orchestra.run.trial111.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 57 MB/s | 30 MB 00:00 2026-02-12T22:47:18.020 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:47:18.020 INFO:teuthology.orchestra.run.trial111.stdout:Total 162 MB/s | 93 MB 00:00 2026-02-12T22:47:18.020 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T22:47:18.026 INFO:teuthology.orchestra.run.trial046.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 57 MB/s | 30 MB 00:00 2026-02-12T22:47:18.027 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:47:18.027 INFO:teuthology.orchestra.run.trial046.stdout:Total 160 MB/s | 93 MB 00:00 2026-02-12T22:47:18.027 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-12T22:47:18.168 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T22:47:18.168 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T22:47:18.174 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-12T22:47:18.174 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-12T22:47:18.572 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T22:47:18.572 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T22:47:18.576 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-12T22:47:18.577 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-12T22:47:19.270 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T22:47:19.271 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-12T22:47:19.471 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:47:19.473 INFO:teuthology.orchestra.run.trial046.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:47:19.492 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:19.494 INFO:teuthology.orchestra.run.trial046.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:20.747 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:20.756 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:47:20.775 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:20.784 INFO:teuthology.orchestra.run.trial046.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:22.626 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:22.632 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:22.632 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:47:22.638 INFO:teuthology.orchestra.run.trial046.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:24.494 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:24.501 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:47:24.504 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:24.511 INFO:teuthology.orchestra.run.trial046.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:26.367 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:26.375 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:59.970 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:47:59.994 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:00.137 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:00.159 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:00.230 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:00.230 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T22:48:00.230 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T22:48:00.231 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T22:48:00.281 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-12T22:48:00.282 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-12T22:48:00.298 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:00.333 INFO:teuthology.orchestra.run.trial111.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.334 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.334 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.334 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:48:00.334 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:48:00.335 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:48:00.335 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial111.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:48:00.335 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:00.345 DEBUG:teuthology.orchestra.run.trial046:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:00.379 INFO:teuthology.orchestra.run.trial046.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.380 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.380 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.380 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:48:00.380 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:48:00.380 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:48:00.381 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial046.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:48:00.381 DEBUG:teuthology.orchestra.run.trial046:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:48:00.407 INFO:teuthology.orchestra.run.trial111.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.408 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.408 DEBUG:teuthology.orchestra.run.trial111:> sudo rpm -qi grub2-tools 2026-02-12T22:48:00.452 INFO:teuthology.orchestra.run.trial046.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.453 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.453 DEBUG:teuthology.orchestra.run.trial046:> sudo rpm -qi grub2-tools 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Name : grub2-tools 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Epoch : 1 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Version : 2.12 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Release : 29.el10_1 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Architecture: x86_64 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Group : Unspecified 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Size : 7963769 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:License : GPL-3.0-or-later 2026-02-12T22:48:00.480 INFO:teuthology.orchestra.run.trial111.stdout:Signature : 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Packager : Release Engineering 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Summary : Support tools for GRUB. 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:Description : 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T22:48:00.481 INFO:teuthology.orchestra.run.trial111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:48:00.482 INFO:teuthology.orchestra.run.trial111.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:48:00.482 INFO:teuthology.orchestra.run.trial111.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:48:00.482 INFO:teuthology.orchestra.run.trial111.stdout:hardware devices. 2026-02-12T22:48:00.482 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T22:48:00.482 INFO:teuthology.orchestra.run.trial111.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:48:00.483 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:48:00.483 INFO:teuthology.task.kernel:Updating grub on trial111 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.483 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:48:00.524 INFO:teuthology.orchestra.run.trial046.stdout:Name : grub2-tools 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Epoch : 1 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Version : 2.12 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Release : 29.el10_1 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Architecture: x86_64 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Group : Unspecified 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Size : 7963769 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:License : GPL-3.0-or-later 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout:Signature : 2026-02-12T22:48:00.525 INFO:teuthology.orchestra.run.trial046.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Packager : Release Engineering 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Summary : Support tools for GRUB. 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:Description : 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:48:00.526 INFO:teuthology.orchestra.run.trial046.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:48:00.527 INFO:teuthology.orchestra.run.trial046.stdout:hardware devices. 2026-02-12T22:48:00.527 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-12T22:48:00.527 INFO:teuthology.orchestra.run.trial046.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:48:00.529 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:48:00.529 INFO:teuthology.task.kernel:Updating grub on trial046 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.529 DEBUG:teuthology.orchestra.run.trial046:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:48:00.549 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:00.550 DEBUG:teuthology.orchestra.run.trial111:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:48:00.594 INFO:teuthology.orchestra.run.trial046.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:00.596 DEBUG:teuthology.orchestra.run.trial046:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:48:00.616 INFO:teuthology.orchestra.run.trial111.stdout:/sbin/grubby 2026-02-12T22:48:00.617 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-12T22:48:00.618 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:48:00.661 INFO:teuthology.orchestra.run.trial046.stdout:/sbin/grubby 2026-02-12T22:48:00.663 INFO:teuthology.orchestra.run.trial046.stdout:yes 2026-02-12T22:48:00.663 DEBUG:teuthology.orchestra.run.trial046:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:48:00.685 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:00.685 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.729 INFO:teuthology.orchestra.run.trial046.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:48:00.730 DEBUG:teuthology.orchestra.run.trial046:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:00.761 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:48:00.807 DEBUG:teuthology.orchestra.run.trial046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:48:00.872 INFO:teuthology.orchestra.run.trial111.stderr:Generating grub configuration file ... 2026-02-12T22:48:00.920 INFO:teuthology.orchestra.run.trial046.stderr:Generating grub configuration file ... 2026-02-12T22:48:01.052 INFO:teuthology.orchestra.run.trial111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:48:01.061 INFO:teuthology.orchestra.run.trial111.stderr:done 2026-02-12T22:48:01.063 DEBUG:teuthology.orchestra.run.trial111:> test -d /sys/firmware/efi 2026-02-12T22:48:01.080 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:48:01.101 INFO:teuthology.orchestra.run.trial046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:48:01.110 INFO:teuthology.orchestra.run.trial046.stderr:done 2026-02-12T22:48:01.112 DEBUG:teuthology.orchestra.run.trial046:> test -d /sys/firmware/efi 2026-02-12T22:48:01.130 DEBUG:teuthology.orchestra.run.trial046:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:48:01.153 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:48:01.153 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/rocky 2026-02-12T22:48:01.155 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:48:01.202 INFO:teuthology.orchestra.run.trial046.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:48:01.202 INFO:teuthology.orchestra.run.trial046.stdout:/boot/efi/EFI/rocky 2026-02-12T22:48:01.203 DEBUG:teuthology.orchestra.run.trial046:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:48:01.220 INFO:teuthology.orchestra.run.trial111.stdout:no 2026-02-12T22:48:01.221 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:48:01.270 INFO:teuthology.orchestra.run.trial046.stdout:no 2026-02-12T22:48:01.271 DEBUG:teuthology.orchestra.run.trial046:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:48:01.288 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-12T22:48:01.288 DEBUG:teuthology.orchestra.run.trial111:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:48:01.338 INFO:teuthology.orchestra.run.trial046.stdout:yes 2026-02-12T22:48:01.339 DEBUG:teuthology.orchestra.run.trial046:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:48:01.354 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial111 2026-02-12T22:48:01.354 DEBUG:teuthology.orchestra.run.trial111:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:48:01.405 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial046 2026-02-12T22:48:01.405 DEBUG:teuthology.orchestra.run.trial046:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:48:01.420 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:48:01.471 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:48:31.397 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:31.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:31.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:31.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:31.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:31.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:31.521 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:31.585 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:31.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:31.607 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:31.607 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:31.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:31.659 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:31.659 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:31.664 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:31.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:31.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:31.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:31.716 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:31.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:31.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:31.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:32.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:32.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:32.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:32.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:32.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:32.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:32.774 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:32.829 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:32.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:32.855 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:32.855 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:32.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:32.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:32.904 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:32.912 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:32.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:32.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:32.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:32.962 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:32.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:32.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:32.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:33.913 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:33.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:33.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:34.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:34.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:34.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:34.063 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:34.075 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:34.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:34.081 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:34.081 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:34.138 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:34.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:34.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:34.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:34.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:34.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:34.163 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:34.220 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:34.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:34.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:34.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:35.139 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:35.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:35.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:35.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:35.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:35.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:35.291 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:35.303 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:35.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:35.309 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:35.309 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:35.366 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:35.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:35.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:35.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:35.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:35.377 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:35.433 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:35.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:35.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:35.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:36.367 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:36.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:36.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:36.467 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:36.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:36.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:36.519 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:36.530 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:36.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:36.536 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:36.536 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:36.592 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:36.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:36.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:36.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:36.606 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:36.606 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:36.664 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:36.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:36.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:36.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:37.594 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:37.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:37.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:37.693 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:37.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:37.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:37.745 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:37.757 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:37.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:37.763 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:37.763 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:37.821 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:37.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:37.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:37.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:37.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:37.842 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:37.842 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:37.899 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:37.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:37.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:37.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:38.822 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:38.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:38.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:38.922 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:38.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:38.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:38.974 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:38.985 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:38.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:38.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:38.992 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:39.048 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:39.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:39.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:39.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:39.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:39.062 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:39.062 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:39.120 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:39.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:39.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:39.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:40.050 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:40.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:40.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:40.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:40.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:40.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:40.201 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:40.213 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:40.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:40.219 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:40.219 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:40.276 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:40.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:40.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:40.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:40.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:40.287 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:40.287 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:40.345 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:40.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:40.345 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:40.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:41.278 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:41.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:41.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:41.366 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:41.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:41.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:41.417 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:41.428 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:41.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:41.434 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:41.434 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:41.491 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:41.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:41.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:41.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:41.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:41.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:41.503 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:41.562 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:41.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:41.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:41.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:42.492 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:42.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:42.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:42.576 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:42.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:42.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:42.629 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:42.640 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:42.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:42.646 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:42.647 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:42.703 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:42.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:42.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:42.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:42.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:42.727 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:42.727 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:42.784 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:42.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:42.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:42.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:43.704 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:43.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:43.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:43.778 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:43.786 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:43.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:43.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:43.854 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:43.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:43.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:43.860 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:43.915 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:43.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:43.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:43.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:43.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:43.935 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:43.935 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:43.992 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:43.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:43.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:43.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:44.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:44.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:44.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:45.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:45.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:45.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:45.067 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:45.078 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:45.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:45.085 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:45.085 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:45.142 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:45.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:45.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:45.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:45.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:45.160 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:45.160 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:45.218 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:45.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:45.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:45.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:46.144 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:46.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:46.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:46.242 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:46.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:46.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:46.294 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:46.306 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:46.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:46.312 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:46.312 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:46.369 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:46.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:46.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:46.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:46.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:46.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:46.385 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:46.443 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:46.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:46.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:46.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:47.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:47.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:47.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:47.469 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:47.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:47.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:47.522 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:47.533 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:47.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:47.539 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:47.539 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:47.596 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:47.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:47.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:47.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:47.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:47.621 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:47.622 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:47.678 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:47.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:47.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:47.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:48.597 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:48.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:48.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:48.684 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:48.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:48.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:48.736 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:48.747 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:48.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:48.754 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:48.754 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:48.810 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:48.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:48.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:48.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:48.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:48.835 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:48.835 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:48.892 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:48.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:48.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:48.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:49.811 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:49.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:49.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:49.902 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:49.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:49.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:49.954 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:49.966 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:49.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:49.972 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:49.972 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:50.029 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:50.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:50.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:50.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:50.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:50.059 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:50.059 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:50.116 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:50.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:50.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:50.116 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:51.030 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:51.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:51.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:51.116 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:51.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:51.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:51.121 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:51.179 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:51.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:51.194 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:51.195 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:51.251 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:51.251 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:51.251 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:51.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:51.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:51.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:51.259 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:51.316 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:51.317 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:51.317 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:51.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:52.252 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:52.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:52.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:52.351 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:52.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:52.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:52.361 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:52.415 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:52.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:52.450 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:52.450 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:52.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:52.490 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:52.490 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:52.506 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:52.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:52.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:52.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:52.547 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:52.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:52.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:52.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:53.508 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:53.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:53.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:53.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:53.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:53.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:53.658 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:53.670 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:53.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:53.676 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:53.676 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:53.732 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:53.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:53.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:53.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:53.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:53.755 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:53.756 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:53.813 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:53.814 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:53.814 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:53.814 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:54.733 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:54.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:54.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:54.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:54.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:54.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:54.890 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:54.902 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:54.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:54.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:54.908 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:54.965 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:54.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:54.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:54.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:54.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:54.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:54.982 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:55.039 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:55.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:55.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:55.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:55.966 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:55.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:55.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:56.053 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:56.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:56.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:56.106 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:56.128 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:56.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:56.129 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:56.129 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:56.185 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:56.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:56.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:56.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:56.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:56.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:56.201 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:56.257 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:56.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:56.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:56.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:57.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:57.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:57.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:57.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:57.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:57.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:57.338 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:57.349 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:57.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:57.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:57.355 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:57.412 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:57.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:57.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:57.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:57.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:57.439 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:57.439 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:57.497 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:57.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:57.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:57.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:58.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:58.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:58.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:58.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:58.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:58.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:58.501 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:58.565 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:58.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:58.576 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:58.576 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:58.633 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:58.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:58.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:58.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:58.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:58.653 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:58.653 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:58.711 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:58.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:58.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:58.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:59.635 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:48:59.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:59.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:59.733 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:48:59.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:59.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:48:59.786 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:48:59.797 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:48:59.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:48:59.803 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:59.803 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:48:59.862 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:59.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:59.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:59.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:48:59.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:48:59.882 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:48:59.882 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:48:59.940 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:48:59.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:48:59.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:48:59.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:00.863 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:00.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:00.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:00.924 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:00.942 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:00.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:00.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:01.013 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:01.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:01.019 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:01.019 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:01.077 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:01.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:01.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:01.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:01.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:01.088 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:01.089 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:01.145 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:01.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:01.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:01.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:02.078 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:02.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:02.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:02.176 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:02.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:02.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:02.229 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:02.240 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:02.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:02.246 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:02.246 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:02.303 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:02.303 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:02.303 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:02.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:02.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:02.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:02.312 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:02.369 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:02.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:02.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:02.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:03.305 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:03.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:03.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:03.405 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:03.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:03.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:03.456 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:03.467 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:03.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:03.473 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:03.474 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:03.530 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:03.530 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:03.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:03.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:03.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:03.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:03.549 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:03.606 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:03.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:03.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:03.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:04.532 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:04.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:04.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:04.633 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:04.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:04.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:04.685 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:04.697 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:04.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:04.702 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:04.703 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:04.759 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:04.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:04.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:04.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:04.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:04.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:04.773 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:04.830 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:04.830 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:04.830 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:04.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:05.760 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:05.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:05.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:05.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:05.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:05.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:05.907 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:05.919 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:05.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:05.925 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:05.925 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:05.982 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:05.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:05.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:05.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:05.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:05.996 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:05.996 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:06.054 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:06.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:06.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:06.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:06.983 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:06.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:06.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:07.083 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:07.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:07.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:07.136 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:07.148 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:07.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:07.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:07.154 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:07.210 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:07.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:07.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:07.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:07.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:07.223 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:07.281 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:07.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:07.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:07.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.212 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:08.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:08.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.310 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:08.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:08.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:08.363 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:08.374 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:08.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:08.380 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.380 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:08.437 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.437 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:08.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:08.448 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:08.448 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:08.505 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:08.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:08.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:08.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:09.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:09.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.538 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:09.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:09.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:09.590 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:09.601 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:09.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:09.607 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.607 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:09.664 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:09.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:09.684 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:09.684 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:09.742 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:09.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:09.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:09.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.665 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:10.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:10.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:10.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:10.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:10.817 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:10.829 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:10.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:10.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.835 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:10.892 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:10.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:10.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:10.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:10.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:10.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:10.905 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:10.963 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:10.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:10.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:10.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:11.894 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:11.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:11.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:11.955 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:11.965 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:11.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:11.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:12.030 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:12.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:12.040 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.040 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:12.096 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:12.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:12.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:12.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:12.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:12.106 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:12.107 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:12.164 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:12.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:12.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:12.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.097 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:13.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:13.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:13.195 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:13.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:13.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:13.248 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:13.260 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:13.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:13.265 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.265 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:13.322 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.322 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:13.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:13.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:13.346 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:13.403 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:13.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:13.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:13.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.323 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:14.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:14.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.406 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:14.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:14.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:14.413 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:14.469 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:14.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:14.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.487 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:14.544 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:14.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:14.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:14.546 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:14.603 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:14.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:14.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:14.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.546 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:15.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:15.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.645 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:15.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:15.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:15.698 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:15.709 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:15.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:15.715 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.715 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:15.773 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:15.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:15.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:15.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:15.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:15.782 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:15.782 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:15.840 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:15.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:15.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:15.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:16.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:16.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:16.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:16.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:16.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:16.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:16.924 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:16.936 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:16.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:16.941 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:16.941 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:16.998 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:16.999 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:16.999 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:16.999 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:17.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:17.020 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:17.020 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:17.077 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:17.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:17.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:17.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:18.000 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:18.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:18.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:18.097 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:18.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:18.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:18.150 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:18.161 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:18.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:18.167 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.167 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:18.224 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.225 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:18.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:18.247 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:18.248 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:18.304 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:18.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:18.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:18.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.226 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:19.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:19.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.324 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:19.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:19.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:19.377 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:19.389 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:19.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:19.394 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.394 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:19.452 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.452 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:19.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:19.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:19.474 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:19.532 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:19.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:19.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:19.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.452 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:20.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:20.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:20.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:20.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:20.605 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:20.616 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:20.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:20.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:20.622 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:20.679 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:20.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:20.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:20.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:20.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:20.701 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:20.701 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:20.759 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:20.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:20.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:20.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:21.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:21.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:21.753 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:21.760 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:21.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:21.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:21.828 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:21.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:21.834 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.834 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:21.890 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:21.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:21.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:21.904 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:21.961 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:21.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:21.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:21.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:22.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:22.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:22.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:22.987 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:22.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:22.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:23.040 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:23.051 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:23.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:23.057 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.057 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:23.114 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:23.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:23.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:23.124 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:23.182 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:23.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:23.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:23.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.115 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:24.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:24.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.213 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:24.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:24.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:24.266 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:24.277 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:24.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:24.283 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.283 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:24.340 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:24.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:24.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:24.364 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:24.420 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:24.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:24.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:24.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:25.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:25.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.440 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:25.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:25.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:25.492 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:25.504 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:25.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:25.509 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:25.509 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:25.566 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:25.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:25.566 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:25.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:25.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:25.592 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:25.592 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:25.650 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:25.650 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:25.650 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:25.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.567 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:26.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:26.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:26.666 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:26.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:26.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:26.718 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:26.730 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:26.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:26.736 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.736 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:26.793 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:26.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:26.815 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:26.815 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:26.872 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:26.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:26.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:26.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:27.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:27.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:27.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.891 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:27.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:27.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:27.943 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:27.955 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:27.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:27.962 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:27.962 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:28.019 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:28.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:28.029 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:28.029 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:28.088 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:28.088 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:28.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:28.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:29.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:29.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:29.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:29.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:29.171 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:29.182 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:29.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:29.188 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.188 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:29.245 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:29.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:29.271 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:29.271 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:29.329 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:29.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:29.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:29.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:30.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:30.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.344 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:30.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:30.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:30.396 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:30.407 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:30.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:30.413 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:30.414 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:30.472 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:30.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:30.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:30.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:30.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:30.495 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:30.495 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:30.553 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:30.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:30.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:30.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.473 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:31.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:31.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:31.571 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:31.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:31.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:31.624 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:31.635 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:31.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:31.641 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.641 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:31.698 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:31.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:31.710 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:31.711 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:31.768 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:31.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:31.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:31.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.699 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:32.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:32.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.796 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:32.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:32.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:32.849 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:32.860 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:32.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:32.866 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.867 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:32.923 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:32.923 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:32.923 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:32.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:32.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:32.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:32.949 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:33.006 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:33.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:33.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:33.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:33.925 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:33.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:33.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:34.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:34.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:34.076 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:34.087 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:34.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:34.093 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.093 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:34.150 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:34.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:34.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:34.169 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:34.227 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:34.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:34.228 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:34.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.151 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:35.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:35.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:35.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:35.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:35.302 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:35.314 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:35.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:35.319 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.320 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:35.376 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:35.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:35.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:35.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:35.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:35.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:35.400 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:35.458 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:35.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:35.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:35.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.378 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:36.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:36.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:36.481 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:36.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:36.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:36.532 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:36.544 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:36.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:36.550 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:36.550 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:36.606 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:36.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:36.617 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:36.617 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:36.674 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:36.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:36.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:36.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.607 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:37.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:37.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:37.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:37.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:37.758 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:37.769 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:37.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:37.776 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.776 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:37.833 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:37.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:37.845 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:37.845 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:37.902 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:37.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:37.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:37.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:38.835 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:38.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:38.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.933 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:38.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:38.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:38.985 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:38.996 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:39.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:39.002 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.002 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:39.059 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:39.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:39.080 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:39.080 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:39.137 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:39.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:39.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:39.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.060 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:40.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:40.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.160 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:40.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:40.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.212 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:40.223 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:40.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:40.230 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.230 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:40.287 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:40.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:40.305 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:40.305 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:40.363 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:40.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:40.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:40.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.289 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:41.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:41.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.388 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:41.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:41.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:41.442 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:41.453 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:41.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:41.459 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.459 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:41.516 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:41.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:41.529 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:41.529 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:41.586 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:41.587 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:41.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:42.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:42.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.617 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:42.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:42.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:42.670 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:42.681 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:42.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:42.687 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.687 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:42.744 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:42.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:42.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:42.759 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:42.815 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:42.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:42.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:42.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.745 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:43.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:43.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.841 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:43.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:43.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:43.894 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:43.906 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:43.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:43.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.912 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:43.968 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:43.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:43.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:43.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:43.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:43.987 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:43.987 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:44.044 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:44.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:44.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:44.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:44.969 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:44.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:44.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:45.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:45.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:45.120 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:45.131 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:45.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:45.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.137 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:45.194 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:45.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:45.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:45.212 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:45.269 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:45.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:45.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:45.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.196 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:46.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:46.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.294 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:46.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:46.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:46.347 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:46.358 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:46.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:46.364 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.364 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:46.421 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:46.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:46.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:46.447 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:46.503 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:46.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:46.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:46.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:47.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:47.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:47.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:47.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:47.573 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:47.584 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:47.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:47.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.590 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:47.647 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:47.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:47.670 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:47.670 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:47.727 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:47.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:47.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:47.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:48.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:48.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.750 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:48.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:48.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:48.802 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:48.814 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:48.819 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:48.819 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.820 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:48.876 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:48.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:48.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:48.886 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:48.943 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:48.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:48.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:48.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:49.878 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:49.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:49.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:49.975 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:49.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:49.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:50.027 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:50.039 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:50.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:50.045 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.045 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:50.102 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:50.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:50.124 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:50.124 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:50.182 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:50.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:50.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:50.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.103 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:51.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:51.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:51.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:51.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:51.250 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:51.262 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:51.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:51.268 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.268 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:51.324 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:51.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:51.339 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:51.339 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:51.396 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:51.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:51.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:51.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.325 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:52.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:52.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.424 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:52.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:52.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:52.476 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:52.487 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:52.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:52.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.493 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:52.550 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:52.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:52.577 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:52.577 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:52.635 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:52.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:52.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:52.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:53.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:53.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.644 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:53.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:53.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:53.696 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:53.707 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:53.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:53.713 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.713 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:53.770 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.770 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:53.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:53.783 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:53.783 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:53.839 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:53.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:53.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:53.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:54.771 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:54.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:54.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.869 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:54.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:54.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:54.921 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:54.933 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:54.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:54.939 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:54.939 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:54.995 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:54.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:54.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:54.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:55.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:55.011 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:55.069 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:55.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:55.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:55.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:55.997 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:55.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:55.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.094 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:56.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:56.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:56.147 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:56.158 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:56.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:56.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.163 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:56.220 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:56.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:56.247 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:56.247 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:56.305 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:56.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:56.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:56.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:57.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:57.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:57.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:57.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:57.372 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:57.383 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:57.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:57.390 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.390 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:57.446 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.447 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.447 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:57.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:57.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:57.471 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:57.528 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:57.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:57.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:57.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.448 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:58.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:58.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.547 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:58.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:58.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:58.598 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:58.610 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:58.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:58.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.616 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:58.673 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:58.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:58.685 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:58.686 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:58.743 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:58.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:58.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:58.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.673 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:49:59.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:59.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.770 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:49:59.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:59.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:59.822 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:49:59.833 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:49:59.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:49:59.840 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.840 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:49:59.896 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:49:59.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:49:59.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:49:59.923 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:49:59.982 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:59.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:49:59.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:49:59.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:00.898 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:00.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:00.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:00.998 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:00.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:00.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:01.050 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:01.061 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:01.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:01.067 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.067 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:01.125 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:01.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:01.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:01.134 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:01.191 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:01.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:01.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:01.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.126 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:02.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:02.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.225 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:02.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:02.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:02.278 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:02.289 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:02.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:02.295 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.295 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:02.353 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:02.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:02.373 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:02.374 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:02.432 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:02.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:02.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:02.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.354 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:03.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:03.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:03.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:03.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:03.496 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:03.508 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:03.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:03.555 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.555 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:03.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:03.593 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:03.593 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:03.612 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:03.651 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:03.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:03.651 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:03.651 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.614 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:04.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:04.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.713 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:04.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:04.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:04.765 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:04.776 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:04.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:04.782 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.782 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:04.840 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:04.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:04.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:04.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:04.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:04.861 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:04.861 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:04.919 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:04.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:04.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:04.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:05.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:05.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:05.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.921 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:05.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:05.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:05.923 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:05.983 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:06.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:06.004 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.004 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:06.062 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:06.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:06.070 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:06.070 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:06.128 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:06.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:06.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:06.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.063 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:07.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:07.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.130 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:07.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:07.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:07.131 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:07.193 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:07.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:07.205 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.205 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:07.262 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:07.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:07.266 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:07.266 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:07.322 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:07.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:07.322 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:07.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:08.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:08.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.347 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:08.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:08.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:08.399 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:08.410 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:08.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:08.416 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.416 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:08.473 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:08.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:08.495 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:08.495 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:08.552 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:08.552 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:08.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:08.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:09.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:09.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:09.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:09.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:09.613 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:09.625 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:09.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:09.630 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.630 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:09.687 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:09.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:09.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:09.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:09.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:09.709 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:09.709 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:09.766 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:09.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:09.767 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:09.767 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:10.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:10.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:10.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:10.788 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:10.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:10.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:10.841 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:10.852 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:10.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:10.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:10.858 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:10.915 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:10.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:10.937 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:10.937 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:10.995 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:10.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:10.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:10.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:11.916 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:11.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:11.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:12.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:12.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:12.069 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:12.080 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:12.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:12.086 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.086 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:12.143 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.144 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.144 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:12.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:12.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:12.165 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:12.221 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:12.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:12.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:12.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.144 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:13.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:13.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:13.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:13.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:13.296 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:13.307 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:13.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:13.313 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.313 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:13.370 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:13.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:13.395 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:13.395 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:13.452 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:13.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:13.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:13.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:14.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:14.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.468 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:14.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:14.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:14.520 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:14.532 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:14.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:14.537 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.538 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:14.594 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:14.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:14.616 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:14.616 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:14.673 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:14.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:14.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:14.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.595 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:15.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:15.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:15.694 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:15.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:15.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:15.746 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:15.757 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:15.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:15.763 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:15.763 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:15.820 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.821 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:15.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:15.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:15.849 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:15.907 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:15.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:15.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:15.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:16.822 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:16.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:16.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.921 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:16.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:16.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:16.973 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:16.984 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:16.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:16.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:16.991 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:17.048 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:17.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:17.069 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:17.070 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:17.126 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:17.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:17.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:17.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.050 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:18.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:18.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.148 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:18.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:18.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:18.201 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:18.212 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:18.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:18.218 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.218 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:18.275 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:18.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:18.289 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:18.289 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:18.345 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:18.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:18.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:18.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.276 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:19.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:19.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:19.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:19.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:19.427 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:19.439 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:19.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:19.445 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.445 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:19.502 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:19.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:19.516 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:19.516 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:19.574 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:19.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:19.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:19.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.503 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:20.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:20.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:20.602 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:20.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:20.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:20.655 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:20.666 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:20.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:20.673 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:20.673 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:20.729 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:20.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:20.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:20.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:20.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:20.752 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:20.752 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:20.809 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:20.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:20.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:20.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.731 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:21.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:21.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.829 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:21.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:21.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:21.881 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:21.893 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:21.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:21.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.899 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:21.956 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:21.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:21.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:21.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:21.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:21.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:21.983 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:22.039 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:22.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:22.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:22.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:22.957 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:22.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:22.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:23.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:23.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:23.107 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:23.119 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:23.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:23.125 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.125 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:23.181 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:23.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:23.195 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:23.195 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:23.253 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:23.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:23.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:23.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:24.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:24.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.281 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:24.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:24.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:24.333 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:24.344 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:24.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:24.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.350 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:24.407 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:24.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:24.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:24.431 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:24.488 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:24.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:24.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:24.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:25.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:25.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:25.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:25.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:25.562 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:25.573 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:25.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:25.579 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:25.579 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:25.636 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:25.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:25.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:25.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:25.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:25.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:25.657 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:25.713 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:25.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:25.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:25.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:26.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:26.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:26.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:26.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:26.787 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:26.798 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:26.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:26.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.805 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:26.861 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:26.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:26.881 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:26.881 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:26.938 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:26.938 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:26.938 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:26.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:27.863 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:27.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:27.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:27.961 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:27.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:27.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:28.029 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:28.041 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:28.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:28.048 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.048 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:28.104 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:28.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:28.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:28.116 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:28.172 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:28.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:28.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:28.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.106 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:29.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:29.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.209 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:29.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:29.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:29.282 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:29.293 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:29.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:29.299 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.299 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:29.356 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:29.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:29.367 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:29.368 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:29.424 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:29.425 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:29.425 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:29.425 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:30.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:30.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:30.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:30.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:30.486 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:30.545 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:30.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:30.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:30.561 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:30.617 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:30.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:30.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:30.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:30.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:30.625 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:30.625 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:30.682 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:30.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:30.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:30.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.618 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:31.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:31.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.732 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:31.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:31.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:31.742 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:31.796 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:31.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:31.828 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.828 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:31.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:31.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:31.870 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:31.884 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:31.927 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:31.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:31.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:31.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:32.885 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:32.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:32.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:32.983 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:32.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:32.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.035 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:33.046 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:33.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:33.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.052 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:33.109 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:33.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:33.125 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:33.125 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:33.183 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:33.183 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:33.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:33.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.110 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:34.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:34.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.208 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:34.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:34.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:34.259 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:34.271 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:34.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:34.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.277 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:34.333 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:34.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:34.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:34.346 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:34.404 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:34.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:34.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:35.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:35.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.434 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:35.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:35.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:35.487 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:35.498 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:35.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:35.504 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.504 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:35.561 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:35.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:35.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:35.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:35.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:35.575 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:35.575 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:35.632 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:35.632 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:35.632 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:35.632 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.563 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:36.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:36.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:36.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:36.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:36.671 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:36.725 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:36.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:36.747 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.747 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:36.803 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:36.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:36.808 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:36.808 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:36.865 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:36.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:36.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:36.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:37.804 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:37.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:37.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.902 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:37.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:37.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:37.955 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:37.966 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:37.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:37.972 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:37.972 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:38.028 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:38.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:38.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:38.056 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:38.113 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:38.113 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:38.113 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:38.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.029 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:39.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:39.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.128 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:39.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:39.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:39.180 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:39.191 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:39.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:39.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.199 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:39.256 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:39.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:39.268 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:39.268 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:39.324 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:39.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:39.325 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:39.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:40.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:40.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.356 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:40.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:40.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:40.409 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:40.420 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:40.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:40.426 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.426 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:40.483 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:40.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:40.504 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:40.504 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:40.561 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:40.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:40.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:40.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.485 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:41.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:41.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:41.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:41.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:41.645 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:41.656 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:41.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:41.703 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.703 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:41.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:41.732 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:41.732 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:41.760 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:41.789 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:41.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:41.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:41.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:42.762 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:42.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:42.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.858 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:42.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:42.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:42.911 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:42.922 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:42.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:42.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:42.928 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:42.985 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:42.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:42.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:42.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:43.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:43.003 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:43.061 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:43.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:43.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:43.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:43.986 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:43.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:43.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.084 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:44.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:44.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:44.136 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:44.147 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:44.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:44.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.154 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:44.210 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:44.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:44.231 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:44.232 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:44.290 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:44.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:44.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:44.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.211 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:45.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:45.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.309 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:45.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:45.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:45.361 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:45.373 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:45.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:45.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.381 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:45.437 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:45.437 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:45.437 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:45.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:45.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:45.462 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:45.463 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:45.520 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:45.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:45.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:45.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.439 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:46.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:46.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.537 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:46.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:46.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:46.588 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:46.599 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:46.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:46.606 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.606 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:46.663 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:46.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:46.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:46.669 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:46.726 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:46.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:46.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:46.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:47.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:47.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:47.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:47.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:47.816 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:47.828 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:47.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:47.834 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.834 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:47.891 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:47.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:47.900 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:47.900 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:47.957 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:47.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:47.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:47.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:48.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:48.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:48.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:48.994 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:48.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:48.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:49.070 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:49.081 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:49.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:49.089 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.089 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:49.146 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:49.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:49.157 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:49.157 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:49.215 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:49.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:49.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:49.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.148 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:50.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:50.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:50.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:50.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:50.300 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:50.311 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:50.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:50.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.317 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:50.375 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:50.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:50.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:50.397 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:50.453 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:50.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:50.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:50.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.377 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:51.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:51.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:51.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:51.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:51.541 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:51.552 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:51.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:51.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.561 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:51.617 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.617 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.617 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.617 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:51.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:51.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:51.629 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:51.686 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:51.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:51.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:51.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.618 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:52.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:52.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.744 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:52.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:52.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:52.754 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:52.808 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:52.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:52.823 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.823 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:52.880 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:52.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:52.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:52.890 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:52.947 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:52.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:52.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:52.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:53.882 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:53.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:53.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.009 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:54.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:54.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:54.019 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:54.075 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:54.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:54.108 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.109 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:54.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:54.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:54.150 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:54.166 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:54.207 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:54.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:54.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:54.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:55.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:55.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.282 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:55.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:55.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:55.291 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:55.346 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:55.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:55.371 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.371 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:55.428 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:55.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:55.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:55.431 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:55.489 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:55.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:55.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:55.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.429 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:56.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:56.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:56.528 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:56.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:56.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:56.580 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:56.592 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:56.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:56.597 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.597 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:56.654 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:56.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:56.681 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:56.681 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:56.738 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:56.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:56.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:56.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:57.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:57.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.755 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:57.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:57.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:57.808 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:57.819 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:57.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:57.825 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.825 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:57.883 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:57.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:57.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:57.890 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:57.948 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:57.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:57.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:57.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.884 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:58.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:58.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.983 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:58.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:58.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.993 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:50:59.047 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:50:59.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:50:59.076 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.076 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:50:59.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:50:59.126 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.126 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:50:59.134 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.184 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.136 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:00.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:00.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.234 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:00.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:00.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.287 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:00.298 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:00.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:00.304 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.304 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:00.361 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:00.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.382 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:00.438 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.362 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:01.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:01.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.461 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:01.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:01.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.514 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:01.525 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:01.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:01.532 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.532 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:01.588 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:01.607 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.607 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:01.664 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.589 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:02.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:02.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:02.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:02.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.741 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:02.752 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:02.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:02.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.758 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:02.815 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:02.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.836 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:02.893 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:03.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:03.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:03.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:03.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.967 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:03.978 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:03.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:03.985 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.985 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:04.043 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.043 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.043 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.043 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:04.061 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.062 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:04.118 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.044 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:05.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:05.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.141 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:05.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:05.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.193 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:05.204 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:05.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:05.210 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.210 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:05.267 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:05.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.285 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:05.343 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:06.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:06.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.372 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:06.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:06.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.424 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:06.435 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:06.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:06.441 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.441 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:06.497 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:06.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.523 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:06.581 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.499 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:07.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:07.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:07.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:07.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.651 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:07.662 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:07.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:07.670 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.670 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:07.727 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.727 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:07.744 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.744 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:07.801 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.728 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:08.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:08.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.827 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:08.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:08.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.880 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:08.891 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:08.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:08.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.897 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:08.954 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.955 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.955 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:08.965 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.965 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:09.023 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.956 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:09.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:09.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:10.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:10.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.107 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:10.119 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:10.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:10.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.126 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:10.183 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:10.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.199 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:10.256 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:11.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:11.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:11.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:11.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.338 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:11.350 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:11.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:11.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.355 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:11.413 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:11.434 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.434 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:11.492 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.492 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:12.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:12.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.513 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:12.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:12.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.565 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:12.576 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:12.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:12.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.582 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:12.639 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:12.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.652 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:12.709 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.641 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:13.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:13.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:13.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:13.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.793 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:13.804 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:13.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:13.810 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.810 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:13.865 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:13.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.889 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:13.946 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.866 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:14.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:14.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.964 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:14.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:14.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:15.017 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:15.028 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:15.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:15.034 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.034 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:15.091 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:15.116 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.116 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:15.173 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:16.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:16.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.189 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:16.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:16.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.241 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:16.252 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:16.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:16.258 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.258 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:16.315 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:16.331 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.331 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:16.388 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:17.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:17.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.415 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:17.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:17.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.467 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:17.479 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:17.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:17.485 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.485 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:17.541 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:17.552 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.553 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:17.610 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.610 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.610 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:18.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:18.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.604 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:18.612 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:18.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:18.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.678 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:18.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:18.684 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.684 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:18.742 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:18.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.764 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:18.821 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.744 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:19.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:19.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.812 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:19.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:19.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:19.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.890 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:19.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:19.896 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.896 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:19.954 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.954 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.954 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.954 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:19.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.970 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:20.026 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.027 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.027 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:20.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:20.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.027 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:21.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:21.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:21.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.093 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:21.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:21.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.104 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:21.161 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:21.175 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.175 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:21.233 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:22.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.234 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:22.234 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:22.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:22.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.303 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:22.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:22.318 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.318 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:22.374 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:22.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.385 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:22.443 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.375 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:23.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:23.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.473 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:23.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:23.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.526 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:23.538 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:23.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:23.544 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.544 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:23.600 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:23.624 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.625 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:23.682 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:24.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:24.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.701 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:24.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:24.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.753 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:24.765 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:24.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:24.771 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.771 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:24.827 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:24.841 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.841 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:24.898 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:25.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:25.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.927 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:25.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:25.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.984 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:25.995 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:26.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:26.001 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.001 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:26.059 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:26.076 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.076 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:26.135 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.060 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:27.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:27.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.158 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:27.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:27.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.210 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:27.221 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:27.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:27.227 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.227 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:27.285 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:27.297 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.297 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:27.355 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.286 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:28.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:28.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.377 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:28.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:28.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.428 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:28.440 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:28.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:28.446 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.446 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:28.503 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:28.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.523 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:28.580 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.581 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.504 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:29.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:29.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.602 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:29.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:29.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.654 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:29.665 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:29.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:29.672 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.672 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:29.729 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:29.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.747 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:29.804 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:30.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:30.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:30.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:30.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.882 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:30.893 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:30.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:30.900 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.900 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:30.957 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:30.979 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.979 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:31.035 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.958 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:31.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:31.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.057 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:32.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:32.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.109 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:32.120 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:32.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:32.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.126 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:32.184 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:32.205 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.205 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:32.263 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:33.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:33.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.284 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:33.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:33.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.337 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:33.348 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:33.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:33.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.354 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:33.410 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.410 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.410 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:33.421 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.421 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:33.478 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.411 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:34.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:34.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.508 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:34.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:34.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.561 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:34.572 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:34.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:34.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.578 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:34.634 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.634 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:34.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.646 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:34.703 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.636 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:35.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:35.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.734 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:35.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:35.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.786 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:35.798 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:35.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:35.803 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.803 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:35.860 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:35.881 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.881 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:35.939 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:36.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:36.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.960 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:36.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:36.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.012 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:37.024 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:37.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:37.030 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.030 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:37.086 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:37.105 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.105 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:37.162 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.087 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:38.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:38.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:38.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:38.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.239 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:38.251 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:38.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:38.257 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.257 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:38.313 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:38.328 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.328 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:38.385 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.386 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.314 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:39.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:39.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.412 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:39.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:39.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.465 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:39.477 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:39.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:39.483 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.483 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:39.541 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:39.557 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.558 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:39.615 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.615 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:40.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:40.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.642 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:40.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:40.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.694 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:40.706 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:40.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:40.712 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.712 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:40.768 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.768 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:40.783 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.783 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:40.841 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.842 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.770 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:41.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:41.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.868 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:41.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:41.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.920 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:41.932 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:41.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:41.938 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.938 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:41.994 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:42.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.018 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:42.076 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.995 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:42.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:42.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.094 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:43.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:43.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.146 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:43.157 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:43.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:43.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.164 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:43.220 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:43.244 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.244 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:43.301 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:44.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:44.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.319 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:44.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:44.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.370 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:44.382 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:44.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:44.429 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.429 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:44.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:44.470 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.471 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:44.486 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.528 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:45.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:45.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.588 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:45.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:45.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.640 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:45.651 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:45.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:45.657 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.657 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:45.713 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:45.722 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.722 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:45.779 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.779 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.779 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.779 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.714 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:46.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:46.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.813 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:46.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:46.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.865 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:46.877 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:46.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:46.883 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.883 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:46.939 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:46.958 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.958 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:47.016 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.941 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:47.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:47.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:48.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:48.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.131 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:48.143 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:48.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:48.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.150 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:48.207 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:48.216 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.216 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:48.274 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.274 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:49.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:49.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.308 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:49.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:49.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.360 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:49.372 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:49.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:49.379 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.379 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:49.436 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.437 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.437 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:49.452 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.452 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:49.509 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:50.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:50.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.531 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:50.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:50.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.584 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:50.595 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:50.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:50.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.601 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:50.657 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:50.672 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.673 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:50.730 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.731 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.731 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:51.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:51.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.731 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:51.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:51.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.733 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:51.797 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:51.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:51.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.815 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:51.872 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:51.879 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.879 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:51.936 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.873 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:52.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:52.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.944 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:52.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:52.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.995 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:53.007 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:53.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:53.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.014 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:53.070 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:53.085 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.086 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:53.143 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.071 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:54.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:54.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.163 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:54.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:54.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.216 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:54.227 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:54.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:54.233 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.233 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:54.289 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.290 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.290 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:54.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.306 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:54.365 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.291 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:55.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:55.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.389 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:55.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:55.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.441 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:55.452 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:55.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:55.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.458 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:55.514 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:55.525 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.526 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:55.582 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.515 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:56.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:56.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.590 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:56.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:56.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.642 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:56.654 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:56.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:56.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.659 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:56.716 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:56.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.736 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:56.795 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:57.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:57.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.815 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:57.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:57.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.867 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:57.878 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:57.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:57.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.884 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:57.941 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:57.951 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.951 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:58.008 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.943 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:58.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:58.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.041 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:59.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:59.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.093 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:51:59.104 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:51:59.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:51:59.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.112 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:51:59.170 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.170 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:51:59.175 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.175 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:51:59.232 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.171 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:00.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:00.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.269 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:00.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:00.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.321 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:00.332 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:00.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:00.338 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.338 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:00.395 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.395 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.395 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:00.413 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.413 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:00.470 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.396 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:01.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:01.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.458 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:01.472 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:01.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:01.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.536 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:01.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:01.547 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.547 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:01.604 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.604 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:01.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.615 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:01.671 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.605 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:02.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:02.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.700 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:02.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:02.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.752 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:02.764 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:02.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:02.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.770 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:02.826 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:02.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.840 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:02.896 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:03.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:03.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.890 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:03.897 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:03.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:03.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.961 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:03.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:03.968 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.968 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:04.024 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:04.052 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.052 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:04.109 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.025 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:05.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:05.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.088 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:05.110 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:05.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:05.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.173 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:05.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:05.178 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.178 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:05.236 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:05.252 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.252 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:05.308 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.237 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:06.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:06.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.337 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:06.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:06.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.389 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:06.400 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:06.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:06.408 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.408 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:06.464 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:06.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.489 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:06.547 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.466 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:07.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:07.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.525 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:07.548 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:07.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:07.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.611 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:07.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:07.617 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.617 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:07.674 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:07.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.688 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:07.744 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.745 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:08.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:08.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:08.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:08.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.825 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:08.837 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:08.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:08.843 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.843 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:08.900 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:08.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.923 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:08.980 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.981 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.901 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:09.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:09.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.999 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:09.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:09.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.052 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:10.063 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:10.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:10.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.069 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:10.126 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:10.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.139 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:10.196 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.127 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:11.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:11.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.186 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:11.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:11.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:11.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.261 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:11.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:11.267 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.268 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:11.324 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:11.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.346 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:11.405 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.325 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:12.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:12.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:12.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:12.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.474 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:12.486 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:12.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:12.492 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.492 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:12.549 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:12.561 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.561 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:12.619 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.620 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:13.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:13.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.649 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:13.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:13.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.701 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:13.712 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:13.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:13.719 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.719 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:13.775 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:13.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.797 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:13.854 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.776 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:14.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:14.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.874 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:14.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:14.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.926 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:14.938 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:14.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:14.944 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.944 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:15.000 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:15.022 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.022 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:15.080 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.081 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:16.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:16.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:16.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:16.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.155 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:16.166 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:16.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:16.172 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.172 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:16.230 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:16.243 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.244 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:16.301 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.231 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:17.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:17.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.330 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:17.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:17.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.383 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:17.395 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:17.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:17.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.401 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:17.458 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:17.475 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.475 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:17.533 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.459 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:18.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:18.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:18.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:18.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.613 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:18.625 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:18.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:18.631 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.631 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:18.688 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:18.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.705 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:18.762 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.689 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:19.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:19.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.749 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:19.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:19.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:19.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.827 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:19.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:19.833 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.833 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:19.890 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:19.909 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.909 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:19.967 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:20.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:20.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.988 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:20.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:20.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.041 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:21.052 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:21.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:21.058 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.058 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:21.115 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:21.121 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.121 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:21.178 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.116 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:22.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:22.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.179 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:22.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:22.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.181 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:22.244 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:22.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:22.261 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.261 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:22.318 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:22.328 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.328 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:22.385 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.320 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:23.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:23.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.419 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:23.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:23.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.472 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:23.483 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:23.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:23.489 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.489 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:23.546 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:23.568 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.568 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:23.625 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.547 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:24.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:24.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.646 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:24.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:24.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.698 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:24.709 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:24.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:24.715 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.715 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:24.773 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:24.792 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.792 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:24.849 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.773 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:25.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:25.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:25.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:25.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.924 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:25.935 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:25.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:25.941 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.942 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:25.998 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:26.026 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.026 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:26.083 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.999 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:26.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:27.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.059 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:27.085 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:27.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:27.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.152 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:27.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:27.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.159 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:27.216 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:27.238 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.239 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:27.296 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.296 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:28.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:28.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:28.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:28.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.369 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:28.380 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:28.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:28.387 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.387 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:28.444 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:28.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.466 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:28.523 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.446 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:29.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:29.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.544 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:29.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:29.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.596 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:29.607 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:29.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:29.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.614 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:29.670 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:29.683 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.683 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:29.741 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.672 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:30.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:30.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.769 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:30.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:30.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.822 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:30.834 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:30.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:30.840 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.840 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:30.898 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:30.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.905 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:30.962 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:31.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:31.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.000 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:32.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:32.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.073 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:32.084 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:32.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:32.090 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.090 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:32.147 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:32.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.169 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:32.226 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.148 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:33.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:33.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:33.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:33.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.300 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:33.312 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:33.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:33.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.317 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:33.374 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:33.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.391 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:33.448 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.375 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:34.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:34.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.480 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:34.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:34.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.533 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:34.544 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:34.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:34.550 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.550 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:34.607 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:34.621 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.622 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:34.680 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.607 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:35.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:35.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:35.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:35.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.758 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:35.769 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:35.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:35.775 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.775 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:35.832 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:35.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.851 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:35.908 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.833 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:36.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:36.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.900 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:36.909 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:36.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:36.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.971 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:36.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:36.977 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.977 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:37.034 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:37.044 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.044 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:37.102 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.103 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.035 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:38.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:38.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:38.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:38.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.168 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:38.180 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:38.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:38.186 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.186 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:38.243 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:38.261 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.261 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:38.318 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.244 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:39.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:39.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.342 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:39.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:39.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.394 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:39.406 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:39.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:39.412 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.412 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:39.469 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.469 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:39.485 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.485 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:39.542 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:40.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:40.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.531 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:40.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:40.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:40.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.607 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:40.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:40.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.613 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:40.670 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:40.694 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.694 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:40.751 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:41.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:41.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.770 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:41.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:41.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.822 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:41.834 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:41.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:41.840 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.840 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:41.897 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:41.919 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.920 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:41.977 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.977 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.898 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:42.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:42.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.996 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:42.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:42.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.050 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:43.061 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:43.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:43.067 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.068 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:43.124 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:43.135 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.135 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:43.191 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.125 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:44.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:44.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:44.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:44.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.250 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:44.312 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:44.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:44.325 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.325 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:44.382 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:44.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.394 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:44.450 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.451 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.451 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.451 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.383 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:45.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:45.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.481 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:45.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:45.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.533 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:45.544 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:45.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:45.551 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.551 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:45.607 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:45.617 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.617 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:45.674 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.608 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:46.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:46.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.707 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:46.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:46.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.785 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:46.797 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:46.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:46.804 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.804 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:46.860 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:46.871 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.872 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:46.929 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:47.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:47.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:47.932 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:47.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:47.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:47.941 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:47.996 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:48.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:48.032 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.032 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:48.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:48.081 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.081 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:48.088 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.088 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.137 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.089 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:49.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:49.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.162 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:49.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:49.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.214 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:49.226 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:49.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:49.232 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.232 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:49.289 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:49.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.306 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:49.363 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.290 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:50.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:50.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.360 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:50.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:50.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:50.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.428 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:50.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:50.440 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.440 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:50.497 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:50.514 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.515 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:50.571 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.498 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:51.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:51.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:51.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:51.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.635 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:51.647 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:51.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:51.653 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.653 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:51.710 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:51.723 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.723 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:51.781 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.712 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:52.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:52.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.837 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:52.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:52.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.889 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:52.900 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:52.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:52.949 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.949 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:52.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:52.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.982 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:53.005 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.040 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.006 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:54.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:54.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.094 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:54.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:54.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.145 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:54.156 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:54.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:54.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.163 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:54.220 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:54.246 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.246 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:54.303 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.303 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:55.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:55.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.310 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:55.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:55.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.317 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:55.373 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:55.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:55.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.400 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:55.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:55.448 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.449 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:55.457 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.505 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.458 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:56.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:56.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:56.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:56.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.606 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:56.617 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:56.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:56.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.624 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:56.679 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:56.695 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.695 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:56.752 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:57.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:57.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.779 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:57.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:57.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.832 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:57.844 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:57.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:57.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.850 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:57.907 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:57.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.932 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:57.989 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.990 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.990 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.908 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:58.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:58.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.984 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:52:58.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:58.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:58.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.060 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:52:59.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:52:59.071 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.072 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:52:59.128 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:52:59.151 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.151 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:52:59.209 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.129 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:00.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:00.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:00.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:00.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.284 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:00.296 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:00.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:00.302 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.302 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:00.358 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.371 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:00.371 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.371 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:00.429 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.429 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.359 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:01.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:01.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:01.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:01.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.496 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:01.557 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:01.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:01.589 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.589 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:01.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:01.633 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.633 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:01.646 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.690 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.647 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:02.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:02.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.745 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:02.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:02.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.798 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:02.810 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:02.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:02.816 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.816 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:02.874 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:02.882 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.883 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:02.939 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.875 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:03.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:03.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.938 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:03.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:03.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:03.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.004 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:04.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:04.015 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.015 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:04.071 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:04.081 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.082 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:04.138 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.072 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:05.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:05.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.173 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:05.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:05.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.226 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:05.237 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:05.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:05.243 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.243 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:05.300 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:05.312 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.312 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:05.371 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:06.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:06.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:06.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:06.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.452 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:06.464 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:06.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:06.470 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.470 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:06.527 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:06.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.546 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:06.603 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.528 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:07.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:07.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.603 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:07.605 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:07.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:07.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.672 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:07.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:07.680 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.681 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:07.737 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:07.753 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.753 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:07.809 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.809 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.738 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:08.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:08.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.810 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:08.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:08.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.813 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:08.875 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:08.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:08.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.899 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:08.956 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:08.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.959 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:09.017 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.957 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:09.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:09.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:10.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:10.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.109 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:10.120 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:10.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:10.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.126 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:10.183 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.183 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:10.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.212 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:10.269 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:11.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:11.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.281 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:11.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:11.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.335 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:11.346 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:11.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:11.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.353 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:11.409 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:11.422 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.422 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:11.478 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:12.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:12.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.496 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:12.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:12.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.548 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:12.559 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:12.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:12.565 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.565 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:12.624 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:12.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.645 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:12.701 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.625 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:13.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:13.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:13.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:13.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.775 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:13.786 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:13.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:13.792 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.792 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:13.849 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:13.876 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.876 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:13.934 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:14.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:14.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:14.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:14.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.001 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:15.013 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:15.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:15.019 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.019 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:15.077 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:15.093 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.093 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:15.150 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.079 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:16.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:16.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.177 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:16.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:16.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.229 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:16.241 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:16.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:16.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.247 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:16.304 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:16.320 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.320 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:16.378 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.306 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:17.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:17.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.404 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:17.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:17.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.457 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:17.468 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:17.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:17.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.474 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:17.531 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:17.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.548 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:17.605 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.534 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:18.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:18.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:18.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:18.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.684 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:18.695 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:18.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:18.702 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.702 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:18.758 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:18.777 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.777 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:18.834 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.760 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:19.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:19.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.860 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:19.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:19.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.913 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:19.925 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:19.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:19.931 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.931 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:19.988 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:19.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.999 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:20.056 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:20.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:20.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:21.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:21.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.140 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:21.152 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:21.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:21.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.158 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:21.215 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:21.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.230 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:21.287 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.216 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:22.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:22.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.315 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:22.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:22.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.367 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:22.378 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:22.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:22.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.385 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:22.442 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:22.452 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.452 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:22.509 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:23.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:23.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.541 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:23.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:23.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.593 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:23.605 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:23.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:23.611 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.611 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:23.667 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:23.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.691 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:23.749 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.668 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:24.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:24.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.753 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:24.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:24.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.805 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:24.816 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:24.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:24.822 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.822 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:24.879 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:24.892 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.892 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:24.949 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.881 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:25.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:25.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.954 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:25.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:25.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.006 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:26.017 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:26.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:26.024 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.024 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:26.080 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:26.093 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.093 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:26.150 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.081 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:27.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:27.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.152 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:27.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:27.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.154 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:27.216 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:27.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:27.228 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.228 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:27.284 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:27.302 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.302 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:27.359 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.359 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.359 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.286 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:28.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:28.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:28.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:28.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.435 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:28.446 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:28.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:28.452 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.453 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:28.509 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:28.528 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.528 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:28.585 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.511 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:29.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:29.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:29.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:29.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.660 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:29.671 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:29.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:29.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.677 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:29.733 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:29.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.754 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:29.811 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.734 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:30.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:30.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.832 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:30.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:30.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.842 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:30.897 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:30.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:30.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.928 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:30.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:30.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.974 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:30.985 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.031 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.986 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:31.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:31.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.084 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:32.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:32.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.137 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T22:53:32.148 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-12T22:53:32.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T22:53:32.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.155 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T22:53:32.212 INFO:teuthology.orchestra.run.trial111.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.212 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.213 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:53:32.224 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:53:32.254 INFO:teuthology.run:Summary data: description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/multifs-auth} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:53:32.254 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:53:32.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-12T22:53:32.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.259 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-12T22:53:32.348 INFO:teuthology.orchestra.run.trial046.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.386 INFO:teuthology.run:FAIL