2026-02-12T22:53:31.226 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:53:31.242 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:53:31.323 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47326 branch: wip-pdonnell-testing-20260210.171210 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47326' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: fs: - name: a - name: b session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - overall HEALTH_ - \(MON_DOWN\) sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: cephfs_name: a client.1: cephfs_name: b selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0eXTt/7pZ/MImk8gKxs/1sxbLj3V1gUJNJ3Unmi0vLmex5TvcR0Hh3fsAMsWDIcXMFIc5DAoA3UNViWs9PNHU= trial114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLweEoebVBsuJISTY5Xp+TnxAegB1J15IDxPTWQOOVxwAvs2ME4yPvOaK/SC2IDrTDrfY7+BdOyYIUBEzpr1eVY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:53:31.323 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:53:31.323 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:53:31.323 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:53:31.325 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:53:31.325 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:53:31.325 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:53:31.325 INFO:teuthology.packaging:ref: None 2026-02-12T22:53:31.325 INFO:teuthology.packaging:tag: None 2026-02-12T22:53:31.325 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:53:31.325 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:53:31.325 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:53:31.450 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:53:31.451 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:53:31.462 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:53:31.462 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:53:31.477 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:53:31.487 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:53:31.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:53:31.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial031.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47326', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:50:09.083050', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0eXTt/7pZ/MImk8gKxs/1sxbLj3V1gUJNJ3Unmi0vLmex5TvcR0Hh3fsAMsWDIcXMFIc5DAoA3UNViWs9PNHU='} 2026-02-12T22:53:31.613 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial114.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47326', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:50:09.082328', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLweEoebVBsuJISTY5Xp+TnxAegB1J15IDxPTWQOOVxwAvs2ME4yPvOaK/SC2IDrTDrfY7+BdOyYIUBEzpr1eVY='} 2026-02-12T22:53:31.613 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:53:31.625 INFO:teuthology.task.internal:roles: ubuntu@trial031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:53:31.625 INFO:teuthology.task.internal:roles: ubuntu@trial114.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-12T22:53:31.625 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:53:31.758 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7923d34e1c60>, signals=[15]) 2026-02-12T22:53:31.758 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:53:31.773 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:53:31.773 DEBUG:teuthology.task.internal:connecting to ubuntu@trial031.front.sepia.ceph.com 2026-02-12T22:53:31.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.833 DEBUG:teuthology.task.internal:connecting to ubuntu@trial114.front.sepia.ceph.com 2026-02-12T22:53:31.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.891 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:53:31.902 DEBUG:teuthology.orchestra.run.trial031:> uname -m 2026-02-12T22:53:31.919 INFO:teuthology.orchestra.run.trial031.stdout:x86_64 2026-02-12T22:53:31.919 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:NAME="Rocky Linux" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:ID="rocky" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="10.1" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;32" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:VENDOR_NAME="RESF" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:53:31.977 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:53:31.978 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server 2026-02-12T22:53:32.041 DEBUG:teuthology.orchestra.run.trial114:> uname -m 2026-02-12T22:53:32.058 INFO:teuthology.orchestra.run.trial114.stdout:x86_64 2026-02-12T22:53:32.058 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:NAME="Rocky Linux" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:ID="rocky" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="10.1" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;32" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:VENDOR_NAME="RESF" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:53:32.115 INFO:teuthology.orchestra.run.trial114.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:53:32.116 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:53:32.116 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:53:32.116 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server 2026-02-12T22:53:32.180 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:53:32.193 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:53:32.205 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:53:32.205 DEBUG:teuthology.orchestra.run.trial031:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:53:32.207 DEBUG:teuthology.orchestra.run.trial114:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:53:32.223 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:53:32.237 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:53:32.238 DEBUG:teuthology.orchestra.run.trial031:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:53:32.265 DEBUG:teuthology.orchestra.run.trial114:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:53:32.281 INFO:teuthology.orchestra.run.trial031.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:53:32.282 INFO:teuthology.orchestra.run.trial114.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:53:32.283 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:53:32.424 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:53:32.444 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:53:32.444 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:53:32.444 DEBUG:teuthology.orchestra.run.trial031:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:53:32.445 DEBUG:teuthology.orchestra.run.trial114:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:53:32.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:53:32.460 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:53:32.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:53:32.461 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:53:32.517 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.518 INFO:teuthology.task.kernel:Running kernel on trial031: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.518 DEBUG:teuthology.orchestra.run.trial031:> sudo yum install -y kernel 2026-02-12T22:53:32.519 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.519 INFO:teuthology.task.kernel:Running kernel on trial114: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.519 DEBUG:teuthology.orchestra.run.trial114:> sudo yum install -y kernel 2026-02-12T22:53:33.022 INFO:teuthology.orchestra.run.trial031.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:53:33.028 INFO:teuthology.orchestra.run.trial114.stdout:Rocky Linux 10 - AppStream 20 MB/s | 2.2 MB 00:00 2026-02-12T22:53:33.383 INFO:teuthology.orchestra.run.trial114.stdout:Rocky Linux 10 - BaseOS 48 MB/s | 11 MB 00:00 2026-02-12T22:53:33.386 INFO:teuthology.orchestra.run.trial031.stdout:Rocky Linux 10 - BaseOS 47 MB/s | 11 MB 00:00 2026-02-12T22:53:33.858 INFO:teuthology.orchestra.run.trial114.stdout:Rocky Linux 10 - CRB 6.9 MB/s | 507 kB 00:00 2026-02-12T22:53:33.899 INFO:teuthology.orchestra.run.trial031.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 507 kB 00:00 2026-02-12T22:53:34.456 INFO:teuthology.orchestra.run.trial031.stdout:Extra Packages for Enterprise Linux 12 MB/s | 6.2 MB 00:00 2026-02-12T22:53:34.905 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 6.2 MB 00:00 2026-02-12T22:53:35.146 INFO:teuthology.orchestra.run.trial031.stdout:lab-extras 167 kB/s | 3.7 kB 00:00 2026-02-12T22:53:35.559 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 295 kB/s | 3.7 kB 00:00 2026-02-12T22:53:35.579 INFO:teuthology.orchestra.run.trial031.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:53:35.591 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-12T22:53:35.593 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T22:53:35.593 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-12T22:53:35.593 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T22:53:35.593 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout:Install 5 Packages 2026-02-12T22:53:35.594 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T22:53:35.595 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 93 M 2026-02-12T22:53:35.595 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 135 M 2026-02-12T22:53:35.595 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-12T22:53:35.675 INFO:teuthology.orchestra.run.trial031.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 17 MB/s | 1.4 MB 00:00 2026-02-12T22:53:35.923 INFO:teuthology.orchestra.run.trial031.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 56 MB/s | 18 MB 00:00 2026-02-12T22:53:35.968 INFO:teuthology.orchestra.run.trial114.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:53:35.979 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-12T22:53:35.980 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-12T22:53:35.981 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-12T22:53:35.982 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-12T22:53:35.982 INFO:teuthology.orchestra.run.trial114.stdout:Install 5 Packages 2026-02-12T22:53:35.982 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-12T22:53:35.982 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 93 M 2026-02-12T22:53:35.982 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 135 M 2026-02-12T22:53:35.982 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-12T22:53:35.986 INFO:teuthology.orchestra.run.trial031.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 45 MB/s | 2.8 MB 00:00 2026-02-12T22:53:36.034 INFO:teuthology.orchestra.run.trial114.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:53:36.191 INFO:teuthology.orchestra.run.trial031.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 68 MB/s | 41 MB 00:00 2026-02-12T22:53:36.231 INFO:teuthology.orchestra.run.trial031.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 53 MB/s | 30 MB 00:00 2026-02-12T22:53:36.232 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:53:36.232 INFO:teuthology.orchestra.run.trial031.stdout:Total 145 MB/s | 93 MB 00:00 2026-02-12T22:53:36.232 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-12T22:53:36.236 INFO:teuthology.orchestra.run.trial114.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 72 MB/s | 18 MB 00:00 2026-02-12T22:53:36.288 INFO:teuthology.orchestra.run.trial114.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 54 MB/s | 2.8 MB 00:00 2026-02-12T22:53:36.378 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-12T22:53:36.378 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-12T22:53:36.445 INFO:teuthology.orchestra.run.trial114.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 72 MB/s | 30 MB 00:00 2026-02-12T22:53:36.780 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-12T22:53:36.780 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-12T22:53:36.784 INFO:teuthology.orchestra.run.trial114.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 51 MB/s | 41 MB 00:00 2026-02-12T22:53:36.785 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:53:36.785 INFO:teuthology.orchestra.run.trial114.stdout:Total 115 MB/s | 93 MB 00:00 2026-02-12T22:53:36.785 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-12T22:53:36.934 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-12T22:53:36.934 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-12T22:53:37.336 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-12T22:53:37.336 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-12T22:53:37.474 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-12T22:53:37.678 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:53:37.700 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:53:38.029 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-12T22:53:38.231 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:53:38.252 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:53:38.950 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:53:38.976 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:53:39.510 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:53:39.538 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:53:40.818 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:53:40.823 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:53:41.379 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:53:41.384 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:53:42.679 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:53:42.689 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:43.245 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:53:43.255 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:44.547 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:53:45.115 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:18.126 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:18.150 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:18.366 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:18.366 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T22:54:18.366 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-12T22:54:18.366 INFO:teuthology.orchestra.run.trial031.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.366 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.367 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.367 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.367 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.367 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T22:54:18.367 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-12T22:54:18.430 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:54:18.503 INFO:teuthology.orchestra.run.trial031.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.504 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.505 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.505 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:54:18.505 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:54:18.505 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:54:18.505 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial031.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:54:18.505 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:54:18.576 INFO:teuthology.orchestra.run.trial031.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.577 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.577 DEBUG:teuthology.orchestra.run.trial031:> sudo rpm -qi grub2-tools 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Name : grub2-tools 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Epoch : 1 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Version : 2.12 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Release : 29.el10_1 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Architecture: x86_64 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Group : Unspecified 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:Size : 7963769 2026-02-12T22:54:18.648 INFO:teuthology.orchestra.run.trial031.stdout:License : GPL-3.0-or-later 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Signature : 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Packager : Release Engineering 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Summary : Support tools for GRUB. 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:Description : 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T22:54:18.649 INFO:teuthology.orchestra.run.trial031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:54:18.650 INFO:teuthology.orchestra.run.trial031.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:54:18.650 INFO:teuthology.orchestra.run.trial031.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:54:18.650 INFO:teuthology.orchestra.run.trial031.stdout:hardware devices. 2026-02-12T22:54:18.650 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-12T22:54:18.650 INFO:teuthology.orchestra.run.trial031.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:54:18.651 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:54:18.651 INFO:teuthology.task.kernel:Updating grub on trial031 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.651 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:54:18.718 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:54:18.720 DEBUG:teuthology.orchestra.run.trial031:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:54:18.785 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/grubby 2026-02-12T22:54:18.785 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:18.786 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-12T22:54:18.787 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:54:18.810 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:18.853 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:54:18.854 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.931 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.040 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.041 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.041 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-12T22:54:19.041 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-12T22:54:19.044 INFO:teuthology.orchestra.run.trial031.stderr:Generating grub configuration file ... 2026-02-12T22:54:19.104 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:54:19.138 INFO:teuthology.orchestra.run.trial114.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.139 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.139 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.140 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:54:19.140 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:54:19.140 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:54:19.140 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial114.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:54:19.140 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:54:19.212 INFO:teuthology.orchestra.run.trial114.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.213 DEBUG:teuthology.orchestra.run.trial114:> sudo rpm -qi grub2-tools 2026-02-12T22:54:19.217 INFO:teuthology.orchestra.run.trial031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:54:19.226 INFO:teuthology.orchestra.run.trial031.stderr:done 2026-02-12T22:54:19.228 DEBUG:teuthology.orchestra.run.trial031:> test -d /sys/firmware/efi 2026-02-12T22:54:19.245 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Name : grub2-tools 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Epoch : 1 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Version : 2.12 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Release : 29.el10_1 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Architecture: x86_64 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Group : Unspecified 2026-02-12T22:54:19.284 INFO:teuthology.orchestra.run.trial114.stdout:Size : 7963769 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:License : GPL-3.0-or-later 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Signature : 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Packager : Release Engineering 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Summary : Support tools for GRUB. 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:Description : 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-12T22:54:19.285 INFO:teuthology.orchestra.run.trial114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:54:19.286 INFO:teuthology.orchestra.run.trial114.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:54:19.286 INFO:teuthology.orchestra.run.trial114.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:54:19.286 INFO:teuthology.orchestra.run.trial114.stdout:hardware devices. 2026-02-12T22:54:19.286 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-12T22:54:19.286 INFO:teuthology.orchestra.run.trial114.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:54:19.287 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:54:19.288 INFO:teuthology.task.kernel:Updating grub on trial114 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.288 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:54:19.314 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:54:19.314 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/rocky 2026-02-12T22:54:19.316 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:54:19.352 INFO:teuthology.orchestra.run.trial114.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:54:19.354 DEBUG:teuthology.orchestra.run.trial114:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:54:19.384 INFO:teuthology.orchestra.run.trial031.stdout:no 2026-02-12T22:54:19.384 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:54:19.419 INFO:teuthology.orchestra.run.trial114.stdout:/sbin/grubby 2026-02-12T22:54:19.421 INFO:teuthology.orchestra.run.trial114.stdout:yes 2026-02-12T22:54:19.421 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:54:19.450 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-12T22:54:19.451 DEBUG:teuthology.orchestra.run.trial031:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:54:19.488 INFO:teuthology.orchestra.run.trial114.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:54:19.489 DEBUG:teuthology.orchestra.run.trial114:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.518 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial031 2026-02-12T22:54:19.518 DEBUG:teuthology.orchestra.run.trial031:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:54:19.567 DEBUG:teuthology.orchestra.run.trial114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:54:19.582 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:54:19.677 INFO:teuthology.orchestra.run.trial114.stderr:Generating grub configuration file ... 2026-02-12T22:54:19.855 INFO:teuthology.orchestra.run.trial114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:54:19.864 INFO:teuthology.orchestra.run.trial114.stderr:done 2026-02-12T22:54:19.866 DEBUG:teuthology.orchestra.run.trial114:> test -d /sys/firmware/efi 2026-02-12T22:54:19.883 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:54:19.955 INFO:teuthology.orchestra.run.trial114.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:54:19.955 INFO:teuthology.orchestra.run.trial114.stdout:/boot/efi/EFI/rocky 2026-02-12T22:54:19.957 DEBUG:teuthology.orchestra.run.trial114:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:54:20.025 INFO:teuthology.orchestra.run.trial114.stdout:no 2026-02-12T22:54:20.025 DEBUG:teuthology.orchestra.run.trial114:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:54:20.093 INFO:teuthology.orchestra.run.trial114.stdout:yes 2026-02-12T22:54:20.093 DEBUG:teuthology.orchestra.run.trial114:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:54:20.159 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial114 2026-02-12T22:54:20.160 DEBUG:teuthology.orchestra.run.trial114:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:54:20.224 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:54:49.560 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:49.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:49.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:49.669 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:49.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:49.757 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:49.757 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:49.814 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:49.814 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:49.814 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:49.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:50.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:50.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.312 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:50.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:50.405 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.405 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:50.462 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.817 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:50.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:50.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.925 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:51.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:51.015 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.015 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:51.072 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.073 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.073 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.073 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:51.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:51.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.572 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:51.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:51.655 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.655 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:51.712 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.075 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:52.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:52.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.135 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:52.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:52.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:52.212 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:52.269 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:52.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:52.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:52.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.714 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:52.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:52.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.822 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:52.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:52.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:52.907 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:52.964 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:52.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:52.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:52.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:53.271 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:53.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:53.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:53.377 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:53.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:53.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:53.451 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:53.508 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:53.509 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:53.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:53.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:53.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:53.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:53.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:54.071 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:54.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:54.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:54.163 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:54.220 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:54.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:54.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:54.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:54.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:54.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:54.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:54.617 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:54.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:54.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:54.690 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:54.746 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:54.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:54.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:54.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:55.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:55.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.341 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:55.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:55.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.430 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:55.487 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:55.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:55.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.856 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:55.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:55.933 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.933 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:55.991 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:56.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:56.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.613 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:56.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:56.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.705 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:56.762 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.762 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.762 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.993 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:56.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:56.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:57.099 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:57.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:57.175 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:57.176 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:57.232 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:57.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:57.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:57.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:57.763 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:57.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:57.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:57.870 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:57.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:57.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:57.948 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:58.004 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:58.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:58.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:58.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:58.234 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:58.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:58.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:58.340 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:58.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:58.415 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:58.415 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:58.471 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:58.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:58.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:58.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:59.006 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:59.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:59.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:59.112 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:54:59.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:54:59.194 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:59.194 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:54:59.251 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:59.251 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:59.251 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:59.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:59.473 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:59.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:59.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:59.580 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:54:59.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:54:59.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:59.666 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:54:59.723 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:59.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:59.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:59.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.252 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:00.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:00.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.319 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:00.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:00.393 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.393 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:00.450 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.725 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:00.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:00.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.832 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:00.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:00.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.921 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:00.979 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.979 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.451 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:01.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:01.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.511 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:01.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:01.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.601 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:01.658 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.980 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:01.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:01.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.087 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:02.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:02.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:02.174 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:02.230 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:02.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:02.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:02.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:02.660 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:02.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:02.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.751 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:02.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:02.827 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:02.827 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:02.883 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:02.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:02.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:02.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:03.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:03.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:03.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:03.339 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:03.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:03.420 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:03.421 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:03.477 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:03.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:03.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:03.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:03.885 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:03.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:03.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:03.977 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:04.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:04.067 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.068 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:04.125 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:04.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:04.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:04.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:04.478 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:04.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:04.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:04.585 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:04.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:04.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.658 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:04.715 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:04.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:04.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:04.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.126 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:05.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:05.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:05.250 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:05.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:05.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.330 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:05.387 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.387 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.387 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.387 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.718 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:05.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:05.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:05.824 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:05.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:05.903 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.903 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:05.960 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.388 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:06.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:06.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.495 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:06.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:06.575 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.576 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:06.633 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:06.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:06.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:07.069 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:07.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:07.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:07.148 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:07.205 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:07.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:07.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:07.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:07.634 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:07.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:07.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:07.695 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:07.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:07.777 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:07.777 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:07.834 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:07.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:07.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:07.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:08.207 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:08.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:08.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:08.314 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:08.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:08.395 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:08.395 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:08.452 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:08.452 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:08.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:08.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:08.837 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:08.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:08.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:08.946 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:09.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:09.022 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.022 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:09.079 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:09.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:09.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:09.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:09.454 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:09.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:09.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.560 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:09.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:09.635 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.635 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:09.692 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:09.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:09.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:09.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.080 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:10.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:10.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:10.188 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:10.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:10.272 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.272 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:10.329 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.694 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:10.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:10.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:10.800 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:10.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:10.892 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.892 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:10.950 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.330 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:11.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:11.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.437 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:11.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:11.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:11.520 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:11.577 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:11.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:11.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:11.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:11.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:11.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:12.058 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:12.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:12.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.138 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:12.195 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:12.580 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:12.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:12.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:12.686 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:12.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:12.760 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.760 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:12.818 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:13.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:13.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:13.304 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:13.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:13.386 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:13.387 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:13.443 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:13.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:13.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:13.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.820 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:13.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:13.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:13.928 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:14.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:14.005 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.005 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:14.062 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.062 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:14.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:14.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:14.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.553 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:14.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:14.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.628 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:14.685 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.064 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:15.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:15.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:15.171 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:15.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:15.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:15.248 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:15.306 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.306 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.687 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:15.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:15.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:15.793 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:15.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:15.882 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:15.882 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:15.939 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:16.308 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:16.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:16.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.415 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:16.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:16.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:16.500 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:16.556 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:16.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:16.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:16.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:16.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:16.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:16.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:17.048 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:17.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:17.140 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.140 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:17.197 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:17.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:17.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:17.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:17.557 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:17.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:17.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:17.664 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:17.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:17.740 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.740 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:17.796 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:17.797 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:17.797 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:17.797 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:18.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:18.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:18.307 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:18.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:18.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:18.390 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:18.447 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.798 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:18.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:18.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:18.904 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:18.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:18.980 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:18.980 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:19.036 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.449 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:19.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:19.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.556 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:19.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:19.632 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.633 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:19.689 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.037 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:20.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:20.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:20.144 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:20.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:20.225 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:20.225 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:20.282 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.691 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:20.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:20.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:20.797 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:20.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:20.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:20.870 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:20.927 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:21.283 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:21.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:21.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.389 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:21.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:21.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:21.464 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:21.521 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:21.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:21.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:21.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:21.929 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:21.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:21.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:22.036 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:22.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:22.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:22.127 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:22.184 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:22.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:22.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:22.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:22.523 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:22.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:22.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:22.630 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:22.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:22.718 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:22.718 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:22.775 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:22.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:22.776 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:22.776 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:23.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:23.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:23.294 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:23.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:23.366 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.366 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:23.423 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.777 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:23.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:23.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:23.885 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:23.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:23.963 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.963 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:24.020 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.425 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:24.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:24.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.531 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:24.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:24.621 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.621 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:24.678 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.022 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:25.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:25.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:25.131 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:25.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:25.216 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:25.216 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:25.273 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.274 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.680 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:25.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:25.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:25.787 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:25.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:25.865 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:25.865 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:25.922 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.923 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:26.276 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:26.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:26.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.386 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:26.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:26.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:26.459 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:26.516 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:26.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:26.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:26.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:26.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:26.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:26.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:27.033 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:27.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:27.114 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:27.114 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:27.171 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:27.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:27.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:27.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:27.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:27.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:27.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:27.630 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:27.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:27.713 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:27.713 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:27.770 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:27.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:27.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:27.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.172 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:28.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:28.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.280 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:28.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:28.364 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.364 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:28.422 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.772 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:28.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:28.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.882 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:28.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:28.957 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.957 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:29.015 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.424 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:29.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:29.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.532 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:29.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:29.612 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.612 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:29.670 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.016 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:30.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:30.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.140 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:30.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:30.221 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:30.222 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:30.279 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:30.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:30.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:30.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:30.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:30.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.743 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:30.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:30.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:30.826 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:30.884 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:30.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:30.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:30.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:31.281 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:31.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:31.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:31.386 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:31.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:31.457 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:31.457 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:31.515 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:31.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:31.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:31.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:31.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:31.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:31.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:31.961 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:32.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:32.043 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:32.043 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:32.100 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:32.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:32.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:32.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:32.516 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:32.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:32.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:32.622 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:32.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:32.702 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:32.702 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:32.759 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:32.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:32.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:32.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.103 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:33.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:33.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.174 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:33.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:33.248 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.248 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:33.305 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.306 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.761 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:33.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:33.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.869 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:33.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:33.945 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.945 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:34.002 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.306 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:34.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:34.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.414 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:34.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:34.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.503 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:34.560 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.004 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:35.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:35.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.110 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:35.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:35.200 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:35.200 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:35.259 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:35.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:35.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:35.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:35.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:35.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.674 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:35.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:35.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:35.767 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:35.824 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:35.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:35.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:35.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:36.261 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:36.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:36.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:36.367 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:36.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:36.447 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:36.447 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:36.504 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:36.505 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:36.505 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:36.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:36.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:36.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:36.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:36.935 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:37.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:37.022 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.022 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:37.079 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:37.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:37.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:37.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:37.614 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:37.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:37.694 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.695 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:37.752 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.081 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:38.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:38.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.189 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:38.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:38.272 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.272 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:38.329 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.755 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:38.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:38.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.867 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:38.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:38.947 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.947 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:39.005 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.331 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:39.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:39.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.437 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:39.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:39.526 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.527 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:39.584 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:40.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:40.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.115 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:40.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:40.198 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:40.198 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:40.255 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:40.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:40.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:40.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.586 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:40.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:40.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.694 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:40.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:40.775 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:40.776 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:40.832 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:40.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:40.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:40.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:41.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:41.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:41.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:41.365 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:41.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:41.444 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:41.444 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:41.501 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:41.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:41.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:41.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:41.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:41.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:41.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:41.939 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:42.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:42.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.019 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:42.076 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:42.503 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:42.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:42.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:42.610 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:42.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:42.686 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.686 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:42.743 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:43.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:43.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.185 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:43.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:43.270 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.270 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:43.325 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.745 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:43.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:43.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.853 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:43.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:43.932 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.932 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:43.989 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.327 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:44.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:44.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.433 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:44.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:44.515 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.515 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:44.572 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.991 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:44.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:44.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.098 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:45.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:45.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:45.180 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:45.237 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:45.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:45.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:45.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:45.574 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:45.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:45.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.681 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:45.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:45.767 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:45.767 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:45.824 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:45.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:45.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:45.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:46.240 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:46.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:46.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:46.347 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:46.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:46.421 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:46.421 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:46.478 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:46.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:46.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:46.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:46.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:46.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:46.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:46.934 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:47.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:47.012 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.012 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:47.069 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.480 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:47.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:47.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.588 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:47.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:47.664 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.665 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:47.722 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.071 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:48.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:48.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.179 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:48.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:48.264 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.264 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:48.321 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.322 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.725 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:48.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:48.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.833 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:48.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:48.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.915 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:48.972 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.323 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:49.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:49.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.431 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:49.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:49.507 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.507 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:49.563 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:49.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:49.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.080 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:50.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:50.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:50.163 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:50.221 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:50.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:50.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:50.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:50.565 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:50.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:50.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.671 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:50.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:50.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:50.754 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:50.811 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:50.812 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:50.812 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:50.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.223 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:51.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:51.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:51.332 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:51.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:51.406 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:51.406 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:51.462 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:51.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:51.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:51.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.813 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:51.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:51.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:51.922 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:51.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:51.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:51.998 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:52.055 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:52.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:52.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.558 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:52.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:52.634 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.635 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:52.693 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:53.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:53.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.186 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:53.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:53.262 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.262 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:53.320 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:53.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:53.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.803 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:53.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:53.887 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.887 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:53.945 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.322 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:54.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:54.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.459 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:54.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:54.534 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.534 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:54.590 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.946 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:54.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:54.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.054 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:55.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:55.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:55.130 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:55.187 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:55.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:55.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:55.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:55.591 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:55.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:55.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.727 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:55.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:55.815 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:55.816 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:55.873 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:55.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:55.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:55.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:56.189 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:56.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:56.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:56.292 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:56.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:56.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:56.374 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:56.432 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:56.875 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:56.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:56.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:56.982 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:57.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:57.051 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.052 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:57.108 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.109 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.433 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:57.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:57.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.542 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:57.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:57.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.628 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:57.685 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.110 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:58.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:58.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.217 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:58.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:58.290 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.290 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:58.346 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:58.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:58.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.796 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:55:58.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:58.878 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.879 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:55:58.936 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.348 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:59.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:59.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.408 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:55:59.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:55:59.490 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:59.490 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:55:59.547 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:59.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:59.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:59.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:59.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:55:59.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:00.046 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:00.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:00.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:00.121 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:00.179 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:00.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:00.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:00.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:00.549 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:00.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:00.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:00.664 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:00.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:00.750 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:00.750 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:00.806 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:00.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:00.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:00.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:01.181 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:01.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:01.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:01.288 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:01.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:01.368 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:01.368 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:01.425 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:01.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:01.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:01.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:01.807 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:01.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:01.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:01.943 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:02.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:02.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:02.018 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:02.075 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:02.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:02.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:02.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.427 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:02.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:02.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.533 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:02.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:02.621 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:02.621 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:02.678 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:02.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:02.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:02.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:03.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:03.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.214 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:03.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:03.288 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:03.288 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:03.346 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:03.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:03.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:03.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:03.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:03.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.788 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:03.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:03.864 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:03.864 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:03.921 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:03.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:03.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:03.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.347 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:04.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:04.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.429 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:04.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:04.504 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:04.504 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:04.561 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:04.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:04.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:04.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:04.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:04.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.031 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:05.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:05.109 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:05.109 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:05.166 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:05.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:05.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:05.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:05.563 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:05.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:05.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.670 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:05.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:05.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:05.745 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:05.803 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:05.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:05.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:05.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:06.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:06.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:06.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:06.278 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:06.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:06.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:06.351 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:06.407 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:06.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:06.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:06.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:06.805 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:06.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:06.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:06.913 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:06.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:06.987 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:06.987 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:07.044 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:07.044 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:07.044 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:07.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.409 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:07.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:07.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.516 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:07.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:07.605 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:07.605 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:07.662 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:07.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:07.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:07.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.046 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:08.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:08.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.154 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:08.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:08.228 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:08.228 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:08.285 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:08.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:08.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:08.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:08.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:08.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.772 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:08.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:08.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:08.850 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:08.907 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:08.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:08.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:08.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:09.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:09.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:09.393 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:09.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:09.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:09.474 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:09.532 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:09.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:09.532 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:09.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.909 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:09.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:09.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.018 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:10.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:10.099 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:10.099 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:10.156 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:10.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:10.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:10.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:10.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:10.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:10.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.665 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:10.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:10.740 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:10.740 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:10.799 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:10.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:10.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:10.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:11.159 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:11.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:11.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:11.266 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:11.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:11.343 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:11.344 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:11.400 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:11.400 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:11.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:11.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:11.801 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:11.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:11.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:11.908 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:11.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:11.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:11.997 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:12.054 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:12.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:12.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:12.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.402 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:12.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:12.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.510 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:12.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:12.591 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:12.591 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:12.648 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:12.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:12.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:12.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:13.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:13.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.163 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:13.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:13.246 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:13.246 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:13.303 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:13.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:13.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:13.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:13.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:13.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.758 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:13.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:13.844 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:13.844 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:13.901 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:13.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:13.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:13.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.306 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:14.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:14.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:14.414 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:14.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:14.492 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:14.492 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:14.549 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:14.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:14.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:14.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.903 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:14.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:14.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.010 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:15.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:15.099 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:15.099 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:15.156 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:15.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:15.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:15.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:15.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:15.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:15.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.659 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:15.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:15.735 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:15.735 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:15.792 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:15.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:15.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:15.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:16.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:16.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:16.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:16.267 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:16.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:16.342 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:16.342 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:16.399 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:16.400 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:16.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:16.400 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:16.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:16.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:16.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:16.902 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:16.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:16.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:16.977 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:17.034 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:17.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:17.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:17.035 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.401 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:17.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:17.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.508 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:17.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:17.597 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:17.597 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:17.654 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:17.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:17.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:17.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.036 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:18.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:18.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.144 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:18.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:18.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:18.230 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:18.286 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:18.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:18.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:18.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:18.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:18.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.765 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:18.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:18.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:18.851 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:18.907 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:18.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:18.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:18.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:19.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:19.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:19.395 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:19.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:19.467 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:19.467 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:19.524 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:19.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:19.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:19.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.909 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:19.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:19.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.017 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:20.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:20.090 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:20.091 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:20.148 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:20.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:20.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:20.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:20.526 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:20.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:20.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.634 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:20.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:20.724 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:20.724 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:20.781 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:20.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:20.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:20.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:21.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:21.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:21.258 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:21.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:21.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:21.335 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:21.392 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:21.393 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:21.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:21.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.783 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:21.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:21.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:21.892 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:21.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:21.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:21.973 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:22.030 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:22.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:22.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:22.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:22.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:22.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.502 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:22.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:22.574 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:22.574 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:22.632 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:22.632 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:22.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:22.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.032 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:23.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:23.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.140 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:23.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:23.215 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:23.215 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:23.273 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:23.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:23.274 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:23.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.634 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:23.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:23.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.738 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:23.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:23.826 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:23.826 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:23.883 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:23.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:23.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:23.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.276 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:24.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:24.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.383 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:24.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:24.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:24.456 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:24.513 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:24.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:24.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:24.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.885 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:24.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:24.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.004 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:25.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:25.080 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:25.080 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:25.137 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:25.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:25.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:25.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:25.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:25.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:25.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.600 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:25.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:25.677 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:25.677 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:25.735 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:25.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:25.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:25.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.139 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:26.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:26.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.248 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:26.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:26.324 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:26.325 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:26.383 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:26.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:26.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:26.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.736 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:26.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:26.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.844 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:26.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:26.926 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:26.926 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:26.984 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:26.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:26.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:26.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.385 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:27.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:27.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.493 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:27.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:27.580 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:27.580 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:27.638 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:27.638 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:27.638 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:27.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:27.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:27.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.094 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:28.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:28.166 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:28.166 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:28.224 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:28.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:28.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:28.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:28.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:28.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.717 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:28.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:28.800 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:28.800 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:28.857 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:28.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:28.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:28.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.225 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:29.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:29.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.334 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:29.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:29.411 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:29.411 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:29.468 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:29.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:29.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:29.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.860 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:29.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:29.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.930 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:30.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:30.011 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:30.011 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:30.067 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:30.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:30.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:30.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:30.469 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:30.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:30.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:30.577 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:30.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:30.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:30.657 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:30.714 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:30.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:30.714 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:30.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:31.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:31.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.136 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:31.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:31.221 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:31.221 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:31.278 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:31.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:31.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:31.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.715 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:31.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:31.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.822 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:31.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:31.909 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:31.909 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:31.967 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:31.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:31.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:31.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.280 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:32.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:32.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.388 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:32.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:32.469 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:32.469 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:32.528 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:32.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:32.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:32.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:32.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:32.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.076 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:33.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:33.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:33.162 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:33.219 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:33.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:33.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:33.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:33.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:33.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.637 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:33.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:33.720 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:33.720 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:33.777 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:33.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:33.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:33.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.221 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:34.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:34.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.329 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:34.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:34.408 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:34.408 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:34.465 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:34.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:34.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:34.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.779 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:34.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:34.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.887 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:34.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:34.979 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:34.979 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:35.036 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:35.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:35.037 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:35.037 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.472 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:35.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:35.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:35.582 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:35.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:35.667 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:35.667 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:35.724 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:35.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:35.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:35.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.038 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:36.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:36.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.144 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:36.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:36.218 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:36.218 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:36.277 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:36.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:36.277 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:36.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:36.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:36.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.834 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:36.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:36.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:36.921 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:36.979 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:36.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:36.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:36.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:37.279 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:37.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:37.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.370 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:37.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:37.448 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:37.448 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:37.506 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:37.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:37.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:37.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:37.981 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:37.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:37.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.087 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:38.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:38.175 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:38.175 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:38.234 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:38.235 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:38.235 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:38.235 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.508 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:38.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:38.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.615 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:38.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:38.701 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:38.701 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:38.758 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:38.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:38.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:38.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:39.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:39.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.333 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:39.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:39.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:39.423 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:39.481 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:39.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:39.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:39.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.760 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:39.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:39.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.868 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:39.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:39.946 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:39.946 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:40.003 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:40.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:40.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:40.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:40.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:40.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.591 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:40.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:40.681 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:40.681 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:40.738 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:40.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:40.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:40.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.005 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:41.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:41.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.095 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:41.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:41.171 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:41.171 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:41.229 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:41.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:41.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:41.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.739 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:41.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:41.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.846 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:41.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:41.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:41.925 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:41.981 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:41.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:41.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:41.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:42.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:42.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:42.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.336 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:42.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:42.421 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:42.421 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:42.479 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:42.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:42.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:42.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:42.983 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:42.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:42.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:43.091 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:43.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:43.164 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:43.164 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:43.221 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:43.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:43.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:43.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:43.481 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:43.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:43.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:43.589 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:43.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:43.663 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:43.663 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:43.720 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:43.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:43.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:43.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.223 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:44.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:44.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.330 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:44.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:44.413 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:44.413 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:44.471 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:44.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:44.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:44.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:44.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:44.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.831 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:44.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:44.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:44.914 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:44.971 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:44.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:44.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:44.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.473 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:45.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:45.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.580 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:45.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:45.667 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:45.668 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:45.725 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:45.725 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:45.725 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:45.725 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:45.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:45.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.081 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:46.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:46.157 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:46.157 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:46.215 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:46.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:46.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:46.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.726 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:46.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:46.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.815 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:46.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:46.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:46.891 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:46.947 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:46.948 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:46.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:46.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:47.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:47.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:47.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.325 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:47.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:47.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:47.401 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:47.458 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:47.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:47.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:47.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:47.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:47.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:47.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.025 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:48.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:48.110 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:48.110 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:48.167 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:48.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:48.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:48.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:48.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:48.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:48.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.567 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:48.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:48.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:48.659 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:48.716 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:48.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:48.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:48.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.169 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:49.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:49.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.236 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:49.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:49.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:49.318 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:49.375 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:49.376 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:49.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:49.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:49.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:49.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.826 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:49.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:49.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:49.914 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:49.971 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:49.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:49.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:49.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.377 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:50.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:50.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.444 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:50.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:50.530 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:50.530 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:50.588 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:50.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:50.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:50.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:50.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:50.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.081 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:51.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:51.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:51.168 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:51.225 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:51.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:51.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:51.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:51.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:51.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:51.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.662 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:51.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:51.741 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:51.742 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:51.799 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:51.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:51.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:51.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:52.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:52.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:52.335 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:52.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:52.416 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:52.417 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:52.474 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:52.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:52.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:52.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.801 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:52.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:52.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:52.908 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:52.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:52.981 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:52.981 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:53.039 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:53.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:53.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:53.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:53.476 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:53.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:53.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:53.584 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:53.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:53.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:53.661 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:53.717 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:53.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:53.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:53.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:54.041 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:54.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:54.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:54.148 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:54.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:54.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:54.223 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:54.281 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:54.281 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:54.281 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:54.281 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:54.719 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:54.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:54.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:54.826 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:54.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:54.903 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:54.903 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:54.960 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:54.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:54.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:54.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.283 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:55.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:55.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:55.389 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:55.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:55.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:55.467 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:55.523 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:55.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:55.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:55.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.963 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:55.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:55.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.071 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:56.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:56.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:56.150 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:56.208 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:56.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:56.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:56.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:56.525 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:56.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:56.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.632 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:56.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:56.722 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:56.722 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:56.779 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:56.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:56.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:56.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:57.210 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:57.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:57.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:57.317 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:57.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:57.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:57.401 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:57.458 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:57.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:57.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:57.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:57.782 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:57.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:57.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:57.889 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:57.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:57.967 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:57.968 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:58.024 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:58.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:58.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:58.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:58.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:58.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:58.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:58.568 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:58.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:58.643 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:58.643 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:58.700 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:58.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:58.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:58.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:59.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:59.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:59.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.134 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:56:59.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:56:59.222 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:59.222 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:56:59.279 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:59.280 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:59.280 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:59.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:59.701 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:59.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:59.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.809 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:56:59.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:56:59.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:59.884 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:56:59.942 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:59.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:59.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:59.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.281 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:00.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:00.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:00.388 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:00.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:00.473 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:00.473 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:00.531 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:00.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:00.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:00.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.944 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:00.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:00.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.051 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:01.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:01.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:01.127 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:01.184 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:01.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:01.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:01.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:01.532 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:01.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:01.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.640 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:01.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:01.713 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:01.713 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:01.770 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:01.771 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:01.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:01.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:02.187 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:02.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:02.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:02.293 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:02.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:02.377 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:02.377 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:02.434 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:02.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:02.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:02.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:02.772 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:02.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:02.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:02.880 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:02.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:02.966 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:02.966 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:03.023 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:03.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:03.024 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:03.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:03.436 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:03.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:03.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:03.543 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:03.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:03.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:03.623 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:03.680 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:03.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:03.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:03.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.025 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:04.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:04.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.133 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:04.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:04.221 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:04.221 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:04.279 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:04.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:04.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:04.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:04.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:04.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.788 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:04.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:04.867 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:04.867 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:04.924 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:04.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:04.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:04.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.281 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:05.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:05.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:05.387 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:05.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:05.468 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:05.468 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:05.525 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:05.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:05.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:05.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:05.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:05.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:06.034 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:06.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:06.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:06.121 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:06.178 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:06.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:06.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:06.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:06.528 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:06.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:06.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:06.635 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:06.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:06.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:06.717 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:06.774 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:06.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:06.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:06.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:07.180 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:07.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:07.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.287 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:07.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:07.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:07.378 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:07.435 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:07.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:07.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:07.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:07.776 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:07.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:07.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.883 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:07.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:07.961 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:07.961 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:08.019 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:08.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:08.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:08.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:08.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:08.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:08.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:08.543 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:08.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:08.620 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:08.620 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:08.677 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:08.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:08.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:08.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.020 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:09.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:09.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.126 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:09.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:09.212 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:09.212 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:09.271 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:09.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:09.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:09.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:09.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:09.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.786 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:09.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:09.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:09.859 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:09.916 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:09.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:09.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:09.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:10.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:10.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:10.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:10.380 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:10.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:10.464 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:10.464 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:10.520 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:10.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:10.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:10.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:10.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:10.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:10.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:11.024 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:11.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:11.108 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:11.108 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:11.166 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:11.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:11.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:11.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:11.522 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:11.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:11.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:11.630 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:11.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:11.713 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:11.713 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:11.770 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:11.771 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:11.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:11.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:12.169 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:12.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:12.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:12.275 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:12.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:12.362 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:12.362 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:12.420 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:12.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:12.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:12.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:12.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:12.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:12.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:12.879 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:12.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:12.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:12.962 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:13.018 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:13.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:13.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:13.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:13.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:13.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:13.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:13.528 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:13.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:13.611 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:13.611 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:13.667 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:13.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:13.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:13.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.020 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:14.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:14.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.128 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:14.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:14.214 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:14.215 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:14.271 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:14.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:14.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:14.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.669 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:14.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:14.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.777 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:14.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:14.862 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:14.862 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:14.919 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:14.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:14.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:14.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:15.273 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:15.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:15.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:15.380 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:15.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:15.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:15.469 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:15.525 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:15.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:15.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:15.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:15.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:15.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:15.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:16.029 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:16.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:16.103 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:16.103 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:16.161 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:16.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:16.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:16.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:16.527 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:16.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:16.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:16.635 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:16.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:16.722 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:16.722 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:16.780 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:16.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:16.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:16.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:17.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:17.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:17.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:17.271 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:17.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:17.344 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:17.344 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:17.402 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:17.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:17.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:17.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:17.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:17.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:17.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:17.888 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:17.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:17.961 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:17.962 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:18.019 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:18.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:18.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:18.019 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:18.404 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:18.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:18.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:18.512 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:18.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:18.596 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:18.596 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:18.654 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:18.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:18.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:18.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.020 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:19.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:19.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.128 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:19.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:19.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:19.210 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:19.268 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:19.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:19.269 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:19.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:19.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:19.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.764 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:19.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:19.853 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:19.853 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:19.910 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:19.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:19.911 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:19.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:20.270 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:20.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:20.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:20.378 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:20.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:20.464 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:20.464 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:20.521 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:20.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:20.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:20.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:20.912 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:20.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:20.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:21.018 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:21.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:21.092 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:21.092 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:21.149 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:21.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:21.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:21.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:21.523 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:21.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:21.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:21.630 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:21.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:21.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:21.715 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:21.772 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:21.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:21.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:21.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:22.151 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:22.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:22.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:22.259 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:22.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:22.338 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:22.338 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:22.394 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:22.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:22.395 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:22.395 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:22.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:22.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:22.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:22.882 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:22.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:22.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:22.973 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:23.031 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:23.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:23.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:23.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:23.397 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:23.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:23.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:23.504 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:23.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:23.594 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:23.594 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:23.652 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:23.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:23.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:23.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:24.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:24.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:24.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.140 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:24.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:24.213 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:24.213 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:24.270 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:24.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:24.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:24.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:24.654 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:24.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:24.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.741 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:24.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:24.817 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:24.817 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:24.874 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:24.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:24.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:24.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:25.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:25.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:25.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:25.380 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:25.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:25.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:25.465 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:25.523 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:25.523 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:25.523 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:25.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:25.876 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:25.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:25.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:25.982 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:26.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:26.068 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:26.068 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:26.125 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:26.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:26.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:26.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:26.525 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:26.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:26.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:26.633 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:26.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:26.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:26.714 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:26.772 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:26.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:26.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:26.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:27.126 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:27.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:27.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:27.227 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:27.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:27.316 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:27.316 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:27.373 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:27.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:27.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:27.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:27.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:27.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:27.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:27.881 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:27.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:27.972 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:27.972 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:28.028 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:28.029 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:28.029 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:28.029 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:28.375 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:28.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:28.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:28.448 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:28.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:28.532 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:28.532 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:28.590 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:28.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:28.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:28.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:29.030 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:29.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:29.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.136 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:29.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:29.215 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:29.216 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:29.272 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:29.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:29.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:29.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:29.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:29.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:29.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.698 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:29.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:29.788 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:29.788 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:29.846 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:29.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:29.846 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:29.847 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:30.274 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:30.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:30.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:30.381 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:30.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:30.470 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:30.471 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:30.528 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:30.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:30.529 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:30.529 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:30.848 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:30.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:30.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:30.955 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:31.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:31.029 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:31.029 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:31.087 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:31.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:31.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:31.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:31.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:31.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:31.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:31.615 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:31.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:31.697 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:31.698 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:31.754 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:31.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:31.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:31.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:32.089 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:32.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:32.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.197 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:32.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:32.281 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:32.281 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:32.339 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:32.339 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:32.339 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:32.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:32.756 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:32.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:32.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.864 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:32.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:32.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:32.949 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:33.006 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:33.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:33.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:33.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:33.340 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:33.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:33.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:33.447 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:33.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:33.531 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:33.531 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:33.589 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:33.589 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:33.589 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:33.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:34.008 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:34.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:34.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.116 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:34.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:34.188 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:34.188 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:34.245 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:34.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:34.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:34.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:34.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:34.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:34.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.698 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:34.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:34.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:34.785 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:34.842 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:34.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:34.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:34.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:35.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:35.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:35.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:35.356 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:35.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:35.439 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:35.439 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:35.497 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:35.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:35.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:35.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:35.844 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:35.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:35.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:35.951 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:36.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:36.031 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:36.031 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:36.089 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:36.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:36.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:36.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:36.498 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:36.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:36.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:36.601 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:36.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:36.687 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:36.687 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:36.744 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:36.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:36.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:36.745 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:37.091 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:37.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:37.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.199 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:37.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:37.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:37.273 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:37.331 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:37.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:37.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:37.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:37.745 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:37.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:37.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.852 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:37.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:37.943 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:37.943 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:38.001 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:38.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:38.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:38.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:38.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:38.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:38.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:38.439 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:38.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:38.519 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:38.520 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:38.576 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:38.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:38.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:38.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:39.003 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:39.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:39.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.111 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:39.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:39.196 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:39.196 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:39.254 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:39.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:39.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:39.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:39.577 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:39.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:39.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.665 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:39.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:39.744 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:39.744 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:39.802 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:39.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:39.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:39.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:40.256 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:40.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:40.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:40.367 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:40.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:40.450 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:40.450 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:40.508 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:40.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:40.509 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:40.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:40.804 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:40.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:40.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:40.896 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:40.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:40.977 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:40.977 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:41.033 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:41.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:41.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:41.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:41.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:41.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:41.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:41.618 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:41.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:41.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:41.704 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:41.761 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:41.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:41.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:41.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.040 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:42.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:42.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.138 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:42.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:42.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:42.220 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:42.277 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:42.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:42.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:42.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:42.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:42.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.871 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:42.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:42.961 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:42.962 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:43.019 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:43.019 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:43.019 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:43.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:43.280 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:43.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:43.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:43.387 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:43.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:43.468 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:43.468 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:43.526 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:43.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:43.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:43.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:44.021 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:44.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:44.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.129 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:44.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:44.216 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:44.216 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:44.272 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:44.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:44.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:44.273 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:44.528 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:44.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:44.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.621 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:44.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:44.709 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:44.709 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:44.766 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:44.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:44.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:44.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:45.273 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:45.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:45.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:45.382 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:45.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:45.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:45.474 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:45.530 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:45.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:45.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:45.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:45.767 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:45.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:45.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:45.874 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:45.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:45.955 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:45.955 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:46.011 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:46.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:46.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:46.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:46.532 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:46.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:46.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:46.619 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:46.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:46.712 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:46.712 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:46.768 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:46.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:46.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:46.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.013 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:47.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:47.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.119 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:47.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:47.196 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:47.197 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:47.254 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:47.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:47.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:47.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.770 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:47.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:47.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.829 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:47.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:47.906 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:47.906 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:47.961 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:47.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:47.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:47.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.255 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:48.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:48.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:48.362 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:48.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:48.445 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:48.445 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:48.502 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:48.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:48.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:48.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:48.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:48.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:49.070 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:49.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:49.156 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:49.156 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:49.214 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:49.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:49.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:49.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:49.504 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:49.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:49.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:49.606 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:49.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:49.684 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:49.684 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:49.741 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:49.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:49.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:49.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:50.216 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:50.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:50.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:50.323 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:50.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:50.398 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:50.398 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:50.455 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:50.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:50.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:50.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:50.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:50.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:50.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:50.850 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:50.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:50.927 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:50.927 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:50.984 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:50.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:50.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:50.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:51.458 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:51.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:51.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:51.568 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:51.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:51.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:51.652 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:51.710 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:51.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:51.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:51.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:51.986 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:51.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:51.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.095 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:52.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:52.180 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:52.180 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:52.238 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:52.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:52.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:52.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:52.712 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:52.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:52.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.820 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:52.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:52.900 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:52.900 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:52.957 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:52.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:52.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:52.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:53.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:53.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:53.347 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:53.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:53.436 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:53.436 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:53.493 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:53.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:53.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:53.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.959 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:53.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:53.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:54.029 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:54.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:54.111 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:54.111 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:54.168 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:54.168 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:54.168 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:54.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:54.495 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:54.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:54.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:54.605 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:54.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:54.696 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:54.696 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:54.754 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:54.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:54.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:54.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:55.169 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:55.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:55.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:55.278 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:55.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:55.354 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:55.354 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:55.412 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:55.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:55.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:55.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:55.755 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:55.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:55.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:55.863 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:55.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:55.943 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:55.944 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:56.000 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:56.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:56.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:56.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:56.414 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:56.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:56.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:56.520 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:56.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:56.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:56.590 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:56.648 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:56.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:56.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:56.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:57.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:57.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.111 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:57.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:57.186 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:57.186 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:57.243 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:57.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:57.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:57.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:57.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:57.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.758 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:57.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:57.832 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:57.832 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:57.891 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:57.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:57.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:57.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:58.244 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:58.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:58.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:58.351 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:58.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:58.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:58.423 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:58.481 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:58.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:58.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:58.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:58.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:58.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:58.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:59.001 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:57:59.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:57:59.084 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:59.084 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:57:59.141 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:59.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:59.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:59.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:59.484 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:59.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:59.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:59.592 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:57:59.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:57:59.685 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:57:59.685 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:57:59.742 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:57:59.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:57:59.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:57:59.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:00.143 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:00.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:00.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:00.250 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:00.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:00.324 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:00.324 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:00.381 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:00.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:00.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:00.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:00.744 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:00.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:00.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:00.804 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:00.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:00.893 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:00.893 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:00.950 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:00.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:00.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:00.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:01.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:01.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:01.490 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:01.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:01.570 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:01.570 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:01.627 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:01.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:01.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:01.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.952 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:01.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:01.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.060 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:02.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:02.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:02.137 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:02.194 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:02.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:02.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:02.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:02.629 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:02.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:02.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.737 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:02.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:02.822 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:02.822 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:02.879 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:02.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:02.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:02.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:03.195 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:03.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:03.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.302 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:03.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:03.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:03.385 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:03.443 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:03.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:03.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:03.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:03.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:03.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:03.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.988 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:04.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:04.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:04.071 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:04.128 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:04.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:04.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:04.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:04.445 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:04.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:04.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:04.553 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:04.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:04.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:04.628 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:04.686 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:04.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:04.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:04.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:05.131 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:05.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:05.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:05.237 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:05.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:05.314 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:05.314 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:05.372 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:05.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:05.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:05.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:05.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:05.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:05.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:05.797 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:05.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:05.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:05.874 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:05.931 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:05.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:05.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:05.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.374 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:06.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:06.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:06.434 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:06.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:06.509 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:06.509 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:06.566 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:06.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:06.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:06.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.933 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:06.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:06.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.041 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:07.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:07.125 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:07.125 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:07.183 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:07.183 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:07.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:07.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:07.568 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:07.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:07.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.630 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:07.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:07.707 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:07.707 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:07.764 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:07.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:07.765 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:07.765 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:08.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:08.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:08.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:08.293 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:08.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:08.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:08.378 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:08.435 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:08.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:08.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:08.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:08.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:08.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:08.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:08.874 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:08.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:08.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:08.952 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:09.009 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:09.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:09.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:09.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:09.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:09.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:09.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:09.544 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:09.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:09.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:09.623 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:09.680 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:09.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:09.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:09.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:10.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:10.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:10.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.119 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:10.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:10.202 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:10.202 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:10.260 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:10.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:10.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:10.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:10.682 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:10.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:10.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.786 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:10.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:10.859 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:10.859 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:10.915 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:10.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:10.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:10.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.262 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:11.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:11.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:11.370 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:11.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:11.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:11.455 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:11.513 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:11.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:11.514 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:11.514 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:11.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:11.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.019 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:12.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:12.093 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:12.093 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:12.150 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:12.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:12.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:12.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:12.515 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:12.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:12.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.610 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:12.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:12.681 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:12.681 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:12.737 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:12.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:12.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:12.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:13.152 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:13.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:13.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:13.259 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:13.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:13.334 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:13.334 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:13.392 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:13.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:13.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:13.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:13.738 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:13.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:13.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:13.797 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:13.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:13.877 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:13.877 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:13.934 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:13.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:13.934 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:13.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:14.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:14.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:14.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:14.502 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:14.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:14.577 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:14.577 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:14.633 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:14.634 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:14.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:14.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:14.934 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:14.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:14.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:14.994 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:15.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:15.069 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:15.069 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:15.125 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:15.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:15.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:15.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:15.634 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:15.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:15.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:15.693 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:15.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:15.773 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:15.773 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:15.830 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:15.830 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:15.830 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:15.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.127 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:16.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:16.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.235 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:16.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:16.309 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:16.309 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:16.367 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:16.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:16.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:16.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.831 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:16.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:16.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.938 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:17.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:17.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:17.012 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:17.068 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:17.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:17.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:17.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:17.369 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:17.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:17.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:17.476 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:17.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:17.566 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:17.567 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:17.623 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:17.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:17.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:17.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:18.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:18.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:18.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:18.178 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:18.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:18.254 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:18.254 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:18.311 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:18.311 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:18.311 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:18.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:18.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:18.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:18.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:18.730 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:18.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:18.812 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:18.812 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:18.869 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:18.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:18.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:18.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:19.313 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:19.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:19.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:19.421 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:19.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:19.510 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:19.511 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:19.568 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:19.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:19.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:19.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:19.870 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:19.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:19.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:19.978 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:20.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:20.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:20.050 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:20.108 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:20.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:20.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:20.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:20.570 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:20.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:20.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:20.654 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:20.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:20.734 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:20.734 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:20.791 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:20.792 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:20.792 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:20.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.110 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:21.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:21.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.218 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:21.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:21.301 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:21.302 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:21.359 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:21.359 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:21.359 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:21.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.793 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:21.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:21.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.903 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:21.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:21.980 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:21.981 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:22.038 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:22.038 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:22.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:22.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:22.360 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:22.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:22.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:22.468 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:22.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:22.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:22.548 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:22.604 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:22.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:22.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:22.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:23.039 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:23.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:23.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:23.146 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:23.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:23.237 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:23.237 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:23.295 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:23.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:23.296 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:23.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:23.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:23.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:23.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:23.666 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:23.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:23.748 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:23.748 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:23.804 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:23.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:23.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:23.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:24.296 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:24.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:24.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:24.405 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:24.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:24.480 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:24.480 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:24.538 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:24.538 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:24.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:24.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:24.805 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:24.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:24.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:24.913 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:24.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:24.995 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:24.995 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:25.053 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:25.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:25.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:25.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:25.540 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:25.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:25.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:25.620 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:25.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:25.697 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:25.697 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:25.753 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:25.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:25.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:25.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:26.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:26.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.161 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:26.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:26.243 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:26.243 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:26.300 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:26.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:26.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:26.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.755 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:26.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:26.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.823 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:26.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:26.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:26.902 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:26.958 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:26.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:26.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:26.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:27.302 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:27.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:27.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:27.410 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:27.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:27.488 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:27.488 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:27.545 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:27.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:27.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:27.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:27.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:27.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:27.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:28.018 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:28.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:28.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:28.102 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:28.158 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:28.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:28.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:28.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:28.546 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:28.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:28.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:28.622 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:28.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:28.708 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:28.708 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:28.765 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:28.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:28.765 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:28.765 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:29.159 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:29.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:29.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:29.267 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:29.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:29.343 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:29.343 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:29.402 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:29.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:29.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:29.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:29.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:29.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:29.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:29.873 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:29.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:29.951 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:29.951 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:30.009 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:30.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:30.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:30.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:30.404 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:30.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:30.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:30.511 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:30.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:30.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:30.602 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:30.660 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:30.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:30.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:30.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:31.011 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:31.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:31.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.119 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:31.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:31.206 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:31.206 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:31.262 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:31.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:31.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:31.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:31.662 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:31.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:31.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.769 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:31.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:31.857 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:31.857 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:31.916 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:31.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:31.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:31.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:32.264 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:32.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:32.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:32.370 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:32.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:32.453 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:32.453 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:32.510 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:32.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:32.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:32.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:32.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:32.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:32.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:33.026 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:33.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:33.105 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:33.105 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:33.161 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:33.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:33.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:33.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:33.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:33.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:33.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:33.610 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:33.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:33.684 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:33.684 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:33.741 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:33.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:33.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:33.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:34.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:34.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:34.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.270 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:34.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:34.357 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:34.357 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:34.415 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:34.415 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:34.415 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:34.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:34.743 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:34.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:34.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.850 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:34.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:34.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:34.932 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:34.988 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:34.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:34.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:34.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:35.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:35.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:35.524 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:35.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:35.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:35.601 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:35.658 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:35.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:35.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:35.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:35.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:35.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.098 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:36.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:36.178 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:36.178 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:36.236 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:36.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:36.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:36.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:36.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:36.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:36.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.734 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:36.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:36.807 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:36.807 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:36.863 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:36.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:36.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:36.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:37.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:37.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:37.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:37.344 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:37.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:37.434 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:37.434 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:37.491 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:37.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:37.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:37.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:37.865 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:37.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:37.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:37.972 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:38.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:38.051 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:38.051 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:38.107 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:38.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:38.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:38.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:38.492 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:38.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:38.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:38.600 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:38.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:38.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:38.674 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:38.732 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:38.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:38.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:38.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:39.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:39.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.218 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:39.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:39.295 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:39.295 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:39.351 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:39.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:39.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:39.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.734 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:39.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:39.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.841 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:39.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:39.912 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:39.912 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:39.971 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:39.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:39.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:39.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.353 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:40.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:40.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:40.460 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:40.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:40.546 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:40.546 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:40.603 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:40.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:40.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:40.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.973 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:40.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:40.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:41.081 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:41.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:41.166 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:41.166 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:41.224 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:41.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:41.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:41.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:41.605 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:41.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:41.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:41.712 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:41.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:41.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:41.785 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:41.842 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:41.843 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:41.843 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:41.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:42.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:42.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:42.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:42.333 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:42.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:42.408 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:42.409 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:42.466 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:42.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:42.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:42.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:42.845 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:42.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:42.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:42.953 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:43.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:43.028 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:43.028 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:43.085 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:43.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:43.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:43.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:43.473 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:43.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:43.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:43.580 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:43.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:43.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:43.671 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:43.728 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:43.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:43.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:43.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.087 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:44.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:44.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.194 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:44.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:44.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:44.277 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:44.335 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:44.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:44.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:44.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.730 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:44.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:44.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.790 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:44.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:44.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:44.873 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:44.930 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:44.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:44.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:44.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:45.336 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:45.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:45.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:45.402 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:45.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:45.479 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:45.479 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:45.535 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:45.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:45.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:45.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:45.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:45.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:45.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:46.039 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:46.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:46.128 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:46.128 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:46.185 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:46.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:46.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:46.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:46.536 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:46.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:46.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:46.644 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:46.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:46.726 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:46.726 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:46.783 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:46.783 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:46.784 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:46.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:47.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:47.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:47.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:47.254 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:47.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:47.329 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:47.329 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:47.387 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:47.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:47.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:47.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:47.785 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:47.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:47.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:47.892 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:47.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:47.977 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:47.977 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:48.035 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:48.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:48.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:48.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:48.389 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:48.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:48.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:48.495 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:48.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:48.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:48.581 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:48.637 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:48.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:48.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:48.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.037 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:49.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:49.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.147 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:49.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:49.234 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:49.234 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:49.291 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:49.291 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:49.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:49.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.639 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:49.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:49.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.747 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:49.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:49.835 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:49.836 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:49.893 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:49.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:49.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:49.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:50.292 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:50.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:50.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:50.358 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:50.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:50.434 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:50.435 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:50.492 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:50.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:50.492 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:50.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:50.895 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:50.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:50.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:51.002 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:51.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:51.092 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:51.092 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:51.150 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:51.150 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:51.150 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:51.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:51.493 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:51.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:51.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:51.559 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:51.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:51.632 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:51.632 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:51.689 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:51.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:51.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:51.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:52.152 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:52.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:52.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:52.259 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:52.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:52.349 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:52.349 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:52.406 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:52.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:52.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:52.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:52.690 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:52.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:52.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:52.796 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:52.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:52.885 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:52.885 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:52.942 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:52.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:52.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:52.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:53.408 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:53.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:53.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:53.514 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:53.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:53.593 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:53.594 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:53.651 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:53.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:53.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:53.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:53.944 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:53.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:53.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.044 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:54.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:54.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:54.127 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:54.186 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:54.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:54.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:54.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:54.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:54.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:54.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.721 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:54.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:54.796 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:54.796 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:54.853 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:54.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:54.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:54.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:55.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:55.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:55.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.296 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:55.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:55.370 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:55.370 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:55.427 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:55.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:55.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:55.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:55.855 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:55.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:55.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.962 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:56.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:56.051 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:56.051 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:56.108 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:56.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:56.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:56.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:56.428 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:56.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:56.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:56.537 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:56.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:56.612 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:56.613 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:56.670 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:56.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:56.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:56.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:57.109 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:57.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:57.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:57.169 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:57.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:57.251 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:57.251 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:57.308 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:57.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:57.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:57.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:57.672 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:57.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:57.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:57.779 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:57.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:57.854 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:57.854 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:57.911 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:57.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:57.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:57.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:58.309 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:58.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:58.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:58.418 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:58.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:58.497 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:58.497 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:58.554 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:58.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:58.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:58.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:58.913 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:58.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:58.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.022 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:58:59.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:58:59.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:59.104 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:58:59.162 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:59.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:59.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:59.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:59.556 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:59.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:59.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.659 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:58:59.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:58:59.742 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:58:59.742 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:58:59.798 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:58:59.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:58:59.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:58:59.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:00.165 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:00.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:00.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.272 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:00.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:00.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:00.355 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:00.412 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:00.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:00.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:00.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:00.801 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:00.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:00.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.908 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:00.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:00.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:00.997 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:01.054 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:01.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:01.054 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:01.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:01.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:01.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:01.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:01.520 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:01.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:01.596 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:01.596 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:01.654 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:01.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:01.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:01.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:02.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:02.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:02.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:02.164 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:02.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:02.254 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:02.254 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:02.310 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:02.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:02.311 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:02.311 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:02.655 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:02.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:02.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:02.763 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:02.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:02.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:02.838 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:02.896 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:02.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:02.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:02.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.312 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:03.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:03.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:03.420 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:03.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:03.497 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:03.497 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:03.553 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:03.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:03.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:03.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.898 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:03.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:03.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:04.006 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:04.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:04.083 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:04.083 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:04.141 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:04.142 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:04.142 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:04.142 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:04.556 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:04.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:04.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:04.662 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:04.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:04.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:04.736 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:04.794 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:04.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:04.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:04.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:05.143 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:05.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:05.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:05.250 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:05.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:05.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:05.330 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:05.387 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:05.387 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:05.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:05.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:05.796 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:05.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:05.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:05.904 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:05.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:05.989 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:05.989 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:06.046 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:06.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:06.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:06.047 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:06.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:06.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:06.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:06.496 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:06.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:06.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:06.586 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:06.642 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:06.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:06.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:06.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:07.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:07.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:07.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:07.156 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:07.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:07.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:07.230 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:07.288 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:07.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:07.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:07.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:07.644 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:07.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:07.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:07.752 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:07.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:07.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:07.841 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:07.898 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:07.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:07.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:07.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:08.291 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:08.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:08.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:08.398 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:08.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:08.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:08.474 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:08.530 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:08.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:08.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:08.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:08.900 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:08.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:08.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:09.009 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:09.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:09.086 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:09.086 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:09.143 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:09.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:09.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:09.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:09.533 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:09.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:09.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:09.619 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:09.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:09.701 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:09.701 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:09.758 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:09.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:09.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:09.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:10.144 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:10.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:10.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:10.222 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:10.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:10.301 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:10.301 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:10.358 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:10.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:10.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:10.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:10.760 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:10.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:10.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:10.868 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:10.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:10.950 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:10.950 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:11.006 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:11.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:11.007 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:11.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:11.360 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:11.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:11.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:11.468 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:11.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:11.544 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:11.544 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:11.601 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:11.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:11.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:11.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:12.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:12.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:12.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:12.067 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:12.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:12.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:12.139 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:12.198 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:12.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:12.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:12.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:12.603 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:12.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:12.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:12.710 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:12.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:12.800 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:12.800 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:12.857 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:12.858 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:12.858 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:12.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:13.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:13.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:13.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:13.309 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:13.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:13.383 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:13.383 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:13.443 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:13.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:13.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:13.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:13.859 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:13.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:13.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:13.965 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:14.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:14.048 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:14.048 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:14.106 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:14.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:14.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:14.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:14.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:14.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:14.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:14.552 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:14.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:14.630 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:14.630 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:14.688 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:14.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:14.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:14.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:15.107 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:15.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:15.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:15.215 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:15.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:15.298 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:15.298 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:15.355 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:15.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:15.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:15.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:15.690 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:15.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:15.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:15.797 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:15.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:15.876 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:15.876 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:15.933 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:15.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:15.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:15.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:16.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:16.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:16.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:16.465 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:16.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:16.546 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:16.547 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:16.603 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:16.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:16.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:16.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:16.935 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:16.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:16.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:17.043 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:17.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:17.132 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:17.132 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:17.190 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:17.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:17.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:17.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:17.605 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:17.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:17.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:17.704 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:17.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:17.790 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:17.790 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:17.847 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:17.847 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:17.847 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:17.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:18.193 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:18.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:18.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:18.301 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:18.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:18.392 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:18.392 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:18.450 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:18.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:18.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:18.451 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:18.849 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:18.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:18.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:18.956 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:19.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:19.032 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:19.033 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:19.089 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:19.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:19.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:19.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:19.452 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:19.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:19.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:19.555 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:19.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:19.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:19.629 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:19.688 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:19.688 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:19.688 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:19.688 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:20.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:20.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:20.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:20.200 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:20.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:20.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:20.280 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:20.337 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:20.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:20.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:20.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:20.689 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:20.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:20.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:20.755 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:20.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:20.839 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:20.839 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:20.896 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:20.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:20.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:20.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:21.339 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:21.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:21.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:21.448 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:21.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:21.539 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:21.540 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:21.596 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:21.597 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:21.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:21.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:21.897 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:21.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:21.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:21.959 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:22.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:22.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:22.042 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:22.098 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:22.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:22.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:22.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:22.598 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:22.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:22.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:22.662 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:22.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:22.739 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:22.739 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:22.798 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:22.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:22.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:22.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:23.100 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:23.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:23.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:23.208 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:23.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:23.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:23.285 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:23.342 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:23.343 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:23.343 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:23.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:23.799 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:23.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:23.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:23.909 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:23.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:23.982 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:23.983 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:24.040 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:24.041 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:24.041 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:24.041 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:24.344 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:24.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:24.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:24.453 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:24.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:24.525 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:24.525 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:24.582 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:24.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:24.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:24.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:25.042 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:25.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:25.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:25.138 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:25.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:25.222 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:25.222 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:25.279 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:25.279 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:25.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:25.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:25.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:25.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:25.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:25.692 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:25.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:25.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:25.765 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:25.822 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:25.822 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:25.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:25.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:26.280 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:26.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:26.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:26.376 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:26.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:26.455 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:26.455 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:26.512 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:26.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:26.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:26.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:26.824 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:26.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:26.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:26.885 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:26.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:26.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:26.970 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:27.027 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:27.027 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:27.027 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:27.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:27.514 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:27.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:27.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:27.580 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:27.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:27.655 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:27.655 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:27.712 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:27.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:27.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:27.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:28.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:28.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:28.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:28.132 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:28.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:28.214 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:28.214 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:28.270 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:28.271 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:28.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:28.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:28.713 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:28.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:28.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:28.822 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:28.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:28.898 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:28.898 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:28.956 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:28.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:28.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:28.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:29.272 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:29.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:29.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:29.377 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:29.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:29.453 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:29.453 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:29.509 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:29.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:29.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:29.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:29.958 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:29.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:29.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:30.065 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:30.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:30.140 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:30.141 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:30.198 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:30.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:30.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:30.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:30.511 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:30.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:30.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:30.621 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:30.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:30.698 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:30.698 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:30.755 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:30.756 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:30.756 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:30.756 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:31.200 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:31.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:31.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:31.307 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:31.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:31.389 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:31.390 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:31.445 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:31.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:31.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:31.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:31.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:31.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:31.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:31.864 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:31.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:31.947 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:31.947 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:32.005 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:32.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:32.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:32.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:32.447 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:32.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:32.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:32.556 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:32.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:32.640 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:32.640 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:32.698 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:32.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:32.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:32.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:33.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:33.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:33.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:33.114 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:33.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:33.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:33.190 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:33.247 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:33.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:33.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:33.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:33.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:33.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:33.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:33.773 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:33.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:33.852 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:33.852 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:33.909 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:33.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:33.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:33.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:34.248 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:34.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:34.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:34.354 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:34.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:34.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:34.440 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:34.498 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:34.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:34.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:34.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:34.910 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:34.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:34.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:34.990 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:35.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:35.078 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:35.078 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:35.136 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:35.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:35.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:35.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:35.500 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:35.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:35.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:35.609 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:35.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:35.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:35.688 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:35.746 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:35.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:35.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:35.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:36.138 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:36.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:36.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:36.197 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:36.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:36.284 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:36.284 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:36.341 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:36.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:36.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:36.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:36.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:36.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:36.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:36.858 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:36.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:36.934 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:36.934 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:36.990 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:36.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:36.990 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:36.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:37.341 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:37.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:37.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:37.450 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:37.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:37.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:37.520 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:37.577 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:37.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:37.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:37.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:37.992 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:37.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:37.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:38.077 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:38.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:38.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:38.165 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:38.223 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:38.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:38.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:38.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:38.580 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:38.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:38.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:38.647 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:38.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:38.729 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:38.729 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:38.786 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:38.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:38.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:38.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:39.225 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:39.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:39.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:39.335 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:39.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:39.424 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:39.424 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:39.481 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:39.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:39.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:39.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:39.790 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:39.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:39.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:39.899 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:39.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:39.975 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:39.975 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:40.031 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:40.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:40.032 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:40.032 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:40.483 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:40.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:40.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:40.590 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:40.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:40.664 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:40.664 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:40.721 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:40.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:40.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:40.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:41.033 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:41.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:41.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:41.138 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:41.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:41.228 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:41.229 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:41.286 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:41.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:41.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:41.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:41.722 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:41.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:41.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:41.830 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:41.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:41.903 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:41.904 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:41.961 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:41.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:41.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:41.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:42.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:42.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:42.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:42.386 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:42.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:42.461 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:42.462 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:42.518 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:42.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:42.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:42.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:42.963 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:42.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:42.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:43.061 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:43.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:43.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:43.138 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:43.195 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:43.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:43.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:43.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:43.519 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:43.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:43.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:43.582 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:43.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:43.657 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:43.657 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:43.714 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:43.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:43.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:43.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:44.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:44.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:44.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:44.305 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:44.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:44.379 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:44.379 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:44.436 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:44.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:44.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:44.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:44.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:44.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:44.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:44.825 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:44.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:44.909 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:44.909 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:44.966 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:44.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:44.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:44.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:45.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:45.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:45.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:45.536 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:45.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:45.612 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:45.613 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:45.669 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:45.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:45.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:45.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:45.969 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:45.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:45.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:46.079 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:46.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:46.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:46.155 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:46.212 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:46.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:46.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:46.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:46.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:46.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:46.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:46.733 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:46.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:46.820 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:46.821 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:46.877 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:46.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:46.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:46.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:47.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:47.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:47.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:47.320 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:47.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:47.404 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:47.404 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:47.461 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:47.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:47.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:47.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:47.878 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:47.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:47.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:47.954 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:48.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:48.030 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:48.030 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:48.088 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:48.088 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:48.088 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:48.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:48.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:48.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:48.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:48.570 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:48.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:48.658 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:48.658 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:48.715 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:48.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:48.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:48.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:49.090 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:49.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:49.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:49.196 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:49.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:49.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:49.273 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:49.329 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:49.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:49.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:49.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:49.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:49.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:49.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:49.825 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-12T22:59:49.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-12T22:59:49.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:49.914 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-12T22:59:49.971 INFO:teuthology.orchestra.run.trial114.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:49.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:49.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:49.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:50.331 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:50.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:50.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:50.416 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-12T22:59:50.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-12T22:59:50.506 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:59:50.507 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-12T22:59:50.564 INFO:teuthology.orchestra.run.trial031.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:59:50.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:59:50.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:59:50.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:50.565 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:50.568 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:59:50.580 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:59:50.617 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:59:50.617 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:59:50.769 INFO:teuthology.run:FAIL