2026-02-12T22:50:32.784 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:50:32.801 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:50:32.887 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47318 branch: wip-pdonnell-testing-20260210.171210 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47318' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: max_mds: 5 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 mds: mds oft prefetch dirfrags: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHsEBUcXG5LG1cO52w/TGYe3SA4zuievyF3AMAlD1g1umKKfMb4k55Y/2LcCryfjOMM4088GnHQXtmXga7IQus= trial082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5D8l8v4IH1RjJDReJpwJ2QXnpmJO1AMKwVmXOT9IAbPhJ9yUdxzxo2goNrGs43fajo669gUxaGpKD67JyqrjU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:50:32.887 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:50:32.887 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:50:32.888 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:50:32.889 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:50:32.889 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:50:32.889 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:50:32.889 INFO:teuthology.packaging:ref: None 2026-02-12T22:50:32.889 INFO:teuthology.packaging:tag: None 2026-02-12T22:50:32.889 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:50:32.889 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:50:32.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:50:33.004 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:50:33.005 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:50:33.017 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:50:33.017 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:50:33.031 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:50:33.048 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:50:33.060 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:50:33.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial049.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47318', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:47:13.620338', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOHsEBUcXG5LG1cO52w/TGYe3SA4zuievyF3AMAlD1g1umKKfMb4k55Y/2LcCryfjOMM4088GnHQXtmXga7IQus='} 2026-02-12T22:50:33.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial082.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47318', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:47:13.620893', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5D8l8v4IH1RjJDReJpwJ2QXnpmJO1AMKwVmXOT9IAbPhJ9yUdxzxo2goNrGs43fajo669gUxaGpKD67JyqrjU='} 2026-02-12T22:50:33.189 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:50:33.200 INFO:teuthology.task.internal:roles: ubuntu@trial049.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:50:33.200 INFO:teuthology.task.internal:roles: ubuntu@trial082.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:50:33.200 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:50:33.334 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x724b18310360>, signals=[15]) 2026-02-12T22:50:33.334 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:50:33.345 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:50:33.345 DEBUG:teuthology.task.internal:connecting to ubuntu@trial049.front.sepia.ceph.com 2026-02-12T22:50:33.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.404 DEBUG:teuthology.task.internal:connecting to ubuntu@trial082.front.sepia.ceph.com 2026-02-12T22:50:33.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:33.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:50:33.476 DEBUG:teuthology.orchestra.run.trial049:> uname -m 2026-02-12T22:50:33.493 INFO:teuthology.orchestra.run.trial049.stdout:x86_64 2026-02-12T22:50:33.493 DEBUG:teuthology.orchestra.run.trial049:> cat /etc/os-release 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:NAME="Rocky Linux" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:ID="rocky" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:VERSION_ID="10.1" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:ANSI_COLOR="0;32" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:VENDOR_NAME="RESF" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:50:33.550 INFO:teuthology.orchestra.run.trial049.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:50:33.551 INFO:teuthology.orchestra.run.trial049.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:50:33.551 INFO:teuthology.orchestra.run.trial049.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:50:33.551 INFO:teuthology.orchestra.run.trial049.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:50:33.551 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:50:33.551 INFO:teuthology.orchestra.run.trial049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:50:33.551 INFO:teuthology.lock.ops:Updating trial049.front.sepia.ceph.com on lock server 2026-02-12T22:50:33.624 DEBUG:teuthology.orchestra.run.trial082:> uname -m 2026-02-12T22:50:33.640 INFO:teuthology.orchestra.run.trial082.stdout:x86_64 2026-02-12T22:50:33.640 DEBUG:teuthology.orchestra.run.trial082:> cat /etc/os-release 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:NAME="Rocky Linux" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:ID="rocky" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_ID="10.1" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:ANSI_COLOR="0;32" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:VENDOR_NAME="RESF" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:50:33.697 INFO:teuthology.orchestra.run.trial082.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:50:33.698 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:50:33.698 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:50:33.698 INFO:teuthology.lock.ops:Updating trial082.front.sepia.ceph.com on lock server 2026-02-12T22:50:33.776 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:50:33.789 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:50:33.800 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:50:33.800 DEBUG:teuthology.orchestra.run.trial049:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:50:33.801 DEBUG:teuthology.orchestra.run.trial082:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:50:33.818 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:50:33.828 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:50:33.828 DEBUG:teuthology.orchestra.run.trial049:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:50:33.858 DEBUG:teuthology.orchestra.run.trial082:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:50:33.874 INFO:teuthology.orchestra.run.trial049.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:50:33.876 INFO:teuthology.orchestra.run.trial082.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:50:33.876 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:50:34.044 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:50:34.063 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:50:34.063 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:50:34.063 DEBUG:teuthology.orchestra.run.trial049:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:50:34.063 DEBUG:teuthology.orchestra.run.trial082:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:50:34.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:50:34.079 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:50:34.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:50:34.079 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:50:34.135 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.135 INFO:teuthology.task.kernel:Running kernel on trial049: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.135 DEBUG:teuthology.orchestra.run.trial049:> sudo yum install -y kernel 2026-02-12T22:50:34.137 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.137 INFO:teuthology.task.kernel:Running kernel on trial082: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:34.137 DEBUG:teuthology.orchestra.run.trial082:> sudo yum install -y kernel 2026-02-12T22:50:34.631 INFO:teuthology.orchestra.run.trial049.stdout:Rocky Linux 10 - AppStream 22 MB/s | 2.2 MB 00:00 2026-02-12T22:50:34.641 INFO:teuthology.orchestra.run.trial082.stdout:Rocky Linux 10 - AppStream 22 MB/s | 2.2 MB 00:00 2026-02-12T22:50:34.984 INFO:teuthology.orchestra.run.trial049.stdout:Rocky Linux 10 - BaseOS 48 MB/s | 11 MB 00:00 2026-02-12T22:50:34.998 INFO:teuthology.orchestra.run.trial082.stdout:Rocky Linux 10 - BaseOS 47 MB/s | 11 MB 00:00 2026-02-12T22:50:35.465 INFO:teuthology.orchestra.run.trial049.stdout:Rocky Linux 10 - CRB 6.3 MB/s | 507 kB 00:00 2026-02-12T22:50:35.529 INFO:teuthology.orchestra.run.trial082.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 507 kB 00:00 2026-02-12T22:50:35.965 INFO:teuthology.orchestra.run.trial049.stdout:Extra Packages for Enterprise Linux 14 MB/s | 6.2 MB 00:00 2026-02-12T22:50:36.370 INFO:teuthology.orchestra.run.trial082.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 6.2 MB 00:00 2026-02-12T22:50:36.615 INFO:teuthology.orchestra.run.trial049.stdout:lab-extras 298 kB/s | 3.7 kB 00:00 2026-02-12T22:50:37.020 INFO:teuthology.orchestra.run.trial049.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:50:37.032 INFO:teuthology.orchestra.run.trial049.stdout:Dependencies resolved. 2026-02-12T22:50:37.033 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T22:50:37.033 INFO:teuthology.orchestra.run.trial049.stdout: Package Arch Version Repo Size 2026-02-12T22:50:37.033 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout:Installing: 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout:Installing dependencies: 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout:Transaction Summary 2026-02-12T22:50:37.034 INFO:teuthology.orchestra.run.trial049.stdout:================================================================================ 2026-02-12T22:50:37.035 INFO:teuthology.orchestra.run.trial049.stdout:Install 5 Packages 2026-02-12T22:50:37.035 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T22:50:37.035 INFO:teuthology.orchestra.run.trial049.stdout:Total download size: 93 M 2026-02-12T22:50:37.035 INFO:teuthology.orchestra.run.trial049.stdout:Installed size: 135 M 2026-02-12T22:50:37.035 INFO:teuthology.orchestra.run.trial049.stdout:Downloading Packages: 2026-02-12T22:50:37.037 INFO:teuthology.orchestra.run.trial082.stdout:lab-extras 311 kB/s | 3.7 kB 00:00 2026-02-12T22:50:37.089 INFO:teuthology.orchestra.run.trial049.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:50:37.327 INFO:teuthology.orchestra.run.trial049.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 63 MB/s | 18 MB 00:00 2026-02-12T22:50:37.396 INFO:teuthology.orchestra.run.trial049.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 40 MB/s | 2.8 MB 00:00 2026-02-12T22:50:37.445 INFO:teuthology.orchestra.run.trial082.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:50:37.457 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T22:50:37.457 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T22:50:37.457 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repo Size 2026-02-12T22:50:37.457 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T22:50:37.457 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:Install 5 Packages 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 93 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 135 M 2026-02-12T22:50:37.458 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T22:50:37.527 INFO:teuthology.orchestra.run.trial049.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 67 MB/s | 30 MB 00:00 2026-02-12T22:50:37.537 INFO:teuthology.orchestra.run.trial082.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2026-02-12T22:50:37.587 INFO:teuthology.orchestra.run.trial049.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 73 MB/s | 41 MB 00:00 2026-02-12T22:50:37.588 INFO:teuthology.orchestra.run.trial049.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:50:37.589 INFO:teuthology.orchestra.run.trial049.stdout:Total 167 MB/s | 93 MB 00:00 2026-02-12T22:50:37.589 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction check 2026-02-12T22:50:37.718 INFO:teuthology.orchestra.run.trial082.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 71 MB/s | 18 MB 00:00 2026-02-12T22:50:37.736 INFO:teuthology.orchestra.run.trial049.stdout:Transaction check succeeded. 2026-02-12T22:50:37.736 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction test 2026-02-12T22:50:37.800 INFO:teuthology.orchestra.run.trial082.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 34 MB/s | 2.8 MB 00:00 2026-02-12T22:50:38.025 INFO:teuthology.orchestra.run.trial082.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 61 MB/s | 30 MB 00:00 2026-02-12T22:50:38.140 INFO:teuthology.orchestra.run.trial049.stdout:Transaction test succeeded. 2026-02-12T22:50:38.140 INFO:teuthology.orchestra.run.trial049.stdout:Running transaction 2026-02-12T22:50:38.141 INFO:teuthology.orchestra.run.trial082.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 59 MB/s | 41 MB 00:00 2026-02-12T22:50:38.142 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:50:38.143 INFO:teuthology.orchestra.run.trial082.stdout:Total 135 MB/s | 93 MB 00:00 2026-02-12T22:50:38.143 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T22:50:38.290 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T22:50:38.290 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T22:50:38.691 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T22:50:38.691 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T22:50:38.832 INFO:teuthology.orchestra.run.trial049.stdout: Preparing : 1/1 2026-02-12T22:50:39.033 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:50:39.055 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:50:39.384 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T22:50:39.585 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:50:39.607 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:50:40.318 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:50:40.345 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:50:40.866 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:50:40.894 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:50:42.189 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:50:42.195 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:50:42.742 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:50:42.747 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:50:44.056 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:50:44.066 INFO:teuthology.orchestra.run.trial049.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:44.606 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:50:44.618 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:45.929 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:46.483 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:19.631 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:19.653 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:19.889 INFO:teuthology.orchestra.run.trial049.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:19.889 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T22:51:19.889 INFO:teuthology.orchestra.run.trial049.stdout:Installed: 2026-02-12T22:51:19.889 INFO:teuthology.orchestra.run.trial049.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.890 INFO:teuthology.orchestra.run.trial049.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.890 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.890 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.890 INFO:teuthology.orchestra.run.trial049.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.890 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T22:51:19.890 INFO:teuthology.orchestra.run.trial049.stdout:Complete! 2026-02-12T22:51:19.953 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:51:20.027 INFO:teuthology.orchestra.run.trial049.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.028 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.029 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.029 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:51:20.029 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:51:20.029 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:51:20.029 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial049.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:51:20.029 DEBUG:teuthology.orchestra.run.trial049:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:51:20.102 INFO:teuthology.orchestra.run.trial049.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.103 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.104 DEBUG:teuthology.orchestra.run.trial049:> sudo rpm -qi grub2-tools 2026-02-12T22:51:20.175 INFO:teuthology.orchestra.run.trial049.stdout:Name : grub2-tools 2026-02-12T22:51:20.175 INFO:teuthology.orchestra.run.trial049.stdout:Epoch : 1 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Version : 2.12 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Release : 29.el10_1 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Architecture: x86_64 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Group : Unspecified 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Size : 7963769 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:License : GPL-3.0-or-later 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Signature : 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:51:20.176 INFO:teuthology.orchestra.run.trial049.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:Packager : Release Engineering 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:Summary : Support tools for GRUB. 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:Description : 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:hardware devices. 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout: 2026-02-12T22:51:20.177 INFO:teuthology.orchestra.run.trial049.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:51:20.179 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:51:20.179 INFO:teuthology.task.kernel:Updating grub on trial049 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.179 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:51:20.245 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:51:20.246 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:20.247 DEBUG:teuthology.orchestra.run.trial049:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:51:20.268 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:20.313 INFO:teuthology.orchestra.run.trial049.stdout:/sbin/grubby 2026-02-12T22:51:20.314 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-12T22:51:20.315 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:51:20.382 INFO:teuthology.orchestra.run.trial049.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:51:20.384 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.460 DEBUG:teuthology.orchestra.run.trial049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:51:20.500 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:51:20.500 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T22:51:20.500 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T22:51:20.500 INFO:teuthology.orchestra.run.trial082.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.500 INFO:teuthology.orchestra.run.trial082.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.501 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.501 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.501 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.501 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T22:51:20.501 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T22:51:20.565 DEBUG:teuthology.orchestra.run.trial082:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:51:20.574 INFO:teuthology.orchestra.run.trial049.stderr:Generating grub configuration file ... 2026-02-12T22:51:20.599 INFO:teuthology.orchestra.run.trial082.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.600 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.600 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:51:20.600 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:51:20.601 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:51:20.601 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial082.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:51:20.601 DEBUG:teuthology.orchestra.run.trial082:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:51:20.674 INFO:teuthology.orchestra.run.trial082.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.675 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.675 DEBUG:teuthology.orchestra.run.trial082:> sudo rpm -qi grub2-tools 2026-02-12T22:51:20.747 INFO:teuthology.orchestra.run.trial082.stdout:Name : grub2-tools 2026-02-12T22:51:20.747 INFO:teuthology.orchestra.run.trial082.stdout:Epoch : 1 2026-02-12T22:51:20.747 INFO:teuthology.orchestra.run.trial082.stdout:Version : 2.12 2026-02-12T22:51:20.747 INFO:teuthology.orchestra.run.trial082.stdout:Release : 29.el10_1 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Architecture: x86_64 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Group : Unspecified 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Size : 7963769 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:License : GPL-3.0-or-later 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Signature : 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Packager : Release Engineering 2026-02-12T22:51:20.748 INFO:teuthology.orchestra.run.trial082.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:Summary : Support tools for GRUB. 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:Description : 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:hardware devices. 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T22:51:20.749 INFO:teuthology.orchestra.run.trial082.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:51:20.750 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:51:20.751 INFO:teuthology.task.kernel:Updating grub on trial082 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.751 DEBUG:teuthology.orchestra.run.trial082:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:51:20.752 INFO:teuthology.orchestra.run.trial049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:51:20.761 INFO:teuthology.orchestra.run.trial049.stderr:done 2026-02-12T22:51:20.762 DEBUG:teuthology.orchestra.run.trial049:> test -d /sys/firmware/efi 2026-02-12T22:51:20.780 DEBUG:teuthology.orchestra.run.trial049:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:51:20.818 INFO:teuthology.orchestra.run.trial082.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:51:20.819 DEBUG:teuthology.orchestra.run.trial082:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:51:20.851 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:51:20.852 INFO:teuthology.orchestra.run.trial049.stdout:/boot/efi/EFI/rocky 2026-02-12T22:51:20.853 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:51:20.885 INFO:teuthology.orchestra.run.trial082.stdout:/sbin/grubby 2026-02-12T22:51:20.886 INFO:teuthology.orchestra.run.trial082.stdout:yes 2026-02-12T22:51:20.887 DEBUG:teuthology.orchestra.run.trial082:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:51:20.921 INFO:teuthology.orchestra.run.trial049.stdout:no 2026-02-12T22:51:20.921 DEBUG:teuthology.orchestra.run.trial049:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:51:20.953 INFO:teuthology.orchestra.run.trial082.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:51:20.954 DEBUG:teuthology.orchestra.run.trial082:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.988 INFO:teuthology.orchestra.run.trial049.stdout:yes 2026-02-12T22:51:20.988 DEBUG:teuthology.orchestra.run.trial049:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:51:21.030 DEBUG:teuthology.orchestra.run.trial082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:51:21.055 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial049 2026-02-12T22:51:21.055 DEBUG:teuthology.orchestra.run.trial049:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:51:21.119 INFO:teuthology.orchestra.run.trial049.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:51:21.144 INFO:teuthology.orchestra.run.trial082.stderr:Generating grub configuration file ... 2026-02-12T22:51:21.325 INFO:teuthology.orchestra.run.trial082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:51:21.335 INFO:teuthology.orchestra.run.trial082.stderr:done 2026-02-12T22:51:21.337 DEBUG:teuthology.orchestra.run.trial082:> test -d /sys/firmware/efi 2026-02-12T22:51:21.354 DEBUG:teuthology.orchestra.run.trial082:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:51:21.427 INFO:teuthology.orchestra.run.trial082.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:51:21.427 INFO:teuthology.orchestra.run.trial082.stdout:/boot/efi/EFI/rocky 2026-02-12T22:51:21.429 DEBUG:teuthology.orchestra.run.trial082:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:51:21.496 INFO:teuthology.orchestra.run.trial082.stdout:no 2026-02-12T22:51:21.497 DEBUG:teuthology.orchestra.run.trial082:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:51:21.563 INFO:teuthology.orchestra.run.trial082.stdout:yes 2026-02-12T22:51:21.564 DEBUG:teuthology.orchestra.run.trial082:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:51:21.630 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial082 2026-02-12T22:51:21.630 DEBUG:teuthology.orchestra.run.trial082:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:51:21.694 INFO:teuthology.orchestra.run.trial082.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:51:51.097 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:51.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:51.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.208 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:51.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:51.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.295 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:51.352 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.672 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:51.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:51.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.783 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:51.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:51.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.858 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:51.916 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.355 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:52.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:52.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.433 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:52.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:52.514 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.514 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:52.571 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.919 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:52.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:52.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.029 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:53.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:53.107 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.107 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:53.164 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.572 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:53.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:53.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.679 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:53.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:53.755 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.755 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:53.812 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.812 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.167 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:54.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:54.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.276 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:54.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:54.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.355 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:54.412 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.814 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:54.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:54.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.892 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:54.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:54.966 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.966 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:55.023 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.023 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.023 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.023 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:55.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:55.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.523 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:55.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:55.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.608 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:55.666 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.025 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:56.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:56.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.101 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:56.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:56.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.177 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:56.235 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.668 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:56.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:56.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.777 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:56.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:56.856 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.857 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:56.914 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:57.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:57.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.320 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:57.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:57.402 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.402 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:57.460 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.460 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.916 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:57.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:57.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.026 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:58.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:58.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.101 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:58.158 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.462 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:58.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:58.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.531 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:58.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:58.612 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.612 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:58.669 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.669 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:59.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:59.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.270 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:51:59.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:51:59.356 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.356 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:51:59.413 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:59.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:59.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.780 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:51:59.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:51:59.857 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.857 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:51:59.915 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.415 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:00.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:00.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.525 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:00.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:00.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.608 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:00.665 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.916 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:00.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:00.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.977 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:01.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:01.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.050 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:01.106 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:01.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:01.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.776 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:01.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:01.853 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.853 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:01.910 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.107 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:02.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:02.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.214 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:02.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:02.301 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.301 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:02.359 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.359 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.359 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.912 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:02.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:02.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.021 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:03.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:03.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.110 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:03.159 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.360 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:03.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:03.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.467 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:03.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:03.555 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.556 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:03.613 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:04.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:04.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.270 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:04.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:04.345 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.345 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:04.403 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.615 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:04.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:04.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.676 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:04.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:04.767 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.767 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:04.823 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.824 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.405 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:05.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:05.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.515 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:05.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:05.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.590 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:05.649 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.649 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.825 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:05.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:05.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.932 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:06.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:06.014 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.014 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:06.071 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:06.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:06.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.759 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:06.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:06.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.832 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:06.889 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.072 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:07.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:07.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.180 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:07.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:07.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.257 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:07.314 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.891 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:07.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:07.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.000 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:08.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:08.075 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.076 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:08.133 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:08.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:08.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.376 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:08.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:08.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.461 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:08.517 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.135 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:09.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:09.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.244 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:09.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:09.318 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.318 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:09.377 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.378 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.378 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.518 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:09.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:09.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.625 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:09.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:09.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.706 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:09.764 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.379 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:10.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:10.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.488 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:10.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:10.586 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.586 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:10.643 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.765 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:10.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:10.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.872 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:10.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:10.951 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.951 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:11.009 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.644 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:11.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:11.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.754 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:11.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:11.836 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.836 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:11.893 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.010 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:12.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:12.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.118 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:12.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:12.196 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.196 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:12.253 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:12.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:12.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.004 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:13.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:13.094 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.095 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:13.152 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.153 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.153 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.254 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:13.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:13.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.362 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:13.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:13.448 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.448 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:13.505 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.154 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:14.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:14.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.263 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:14.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:14.339 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.339 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:14.396 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:14.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:14.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:14.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.507 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:14.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:14.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.603 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:14.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:14.689 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.689 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:14.746 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:14.747 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:14.747 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:14.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:15.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:15.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.506 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:15.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:15.581 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.581 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:15.638 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:15.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:15.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.836 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:15.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:15.919 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.919 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:15.977 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:16.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:16.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.750 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:16.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:16.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.821 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:16.878 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.979 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:16.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:16.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.069 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:17.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:17.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.148 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:17.206 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:17.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:17.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.990 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:18.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:18.063 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.063 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:18.121 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.207 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:18.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:18.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.317 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:18.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:18.397 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.397 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:18.454 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.123 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:19.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:19.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.233 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:19.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:19.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.314 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:19.371 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:19.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:19.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.563 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:19.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:19.655 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.655 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:19.712 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.373 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:20.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:20.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.483 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:20.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:20.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.561 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:20.618 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.714 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:20.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:20.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.820 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:20.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:20.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.904 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:20.961 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.620 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:21.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:21.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.730 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:21.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:21.806 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.806 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:21.863 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:21.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:21.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.069 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:22.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:22.153 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.153 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:22.211 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.865 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:22.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:22.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.983 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:23.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:23.059 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.059 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:23.116 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.116 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.213 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:23.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:23.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.272 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:23.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:23.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.348 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:23.405 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.117 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:24.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:24.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.182 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:24.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:24.269 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.269 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:24.325 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:24.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:24.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.514 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:24.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:24.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.590 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:24.647 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:25.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:25.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.437 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:25.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:25.527 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.527 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:25.584 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.648 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:25.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:25.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.749 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:25.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:25.824 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.824 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:25.881 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.585 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:26.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:26.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.717 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:26.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:26.793 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.793 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:26.851 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.883 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:26.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:26.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.984 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:27.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:27.063 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.063 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:27.120 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.853 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:27.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:27.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.986 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:28.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:28.060 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.060 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:28.117 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:28.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:28.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.219 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:28.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:28.294 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.294 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:28.352 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.118 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:29.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:29.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.256 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:29.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:29.341 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.341 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:29.355 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:29.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:29.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.432 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:29.439 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:29.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.505 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:29.562 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:30.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:30.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.551 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:30.564 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:30.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:30.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.624 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:30.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:30.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.642 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:30.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:30.697 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.697 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:30.699 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.754 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.755 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.755 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:31.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:31.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:31.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:31.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.846 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:31.856 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:31.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:31.905 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.906 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:31.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:31.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.930 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:31.962 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.986 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:32.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:32.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.019 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:33.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:33.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.071 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:33.080 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:33.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:33.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.127 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:33.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:33.154 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.154 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:33.185 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.211 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:34.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:34.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:34.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:34.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.336 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:34.345 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:34.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:34.394 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.394 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:34.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:34.432 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.432 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:34.450 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.489 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.451 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:35.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:35.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:35.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:35.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.602 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:35.612 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:35.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:35.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.660 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:35.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:35.695 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.695 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:35.716 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.751 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:36.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:36.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.816 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:36.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:36.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.868 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:36.877 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:36.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:36.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.929 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:36.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:36.950 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.950 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:36.986 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.008 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.008 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.987 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:37.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:37.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.066 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:38.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:38.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.118 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:38.127 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:38.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:38.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.136 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:38.192 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:38.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.200 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:38.256 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.256 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.256 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.193 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:39.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:39.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:39.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:39.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.344 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:39.353 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:39.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:39.403 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.403 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:39.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:39.434 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.434 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:39.460 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.491 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.491 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.491 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.491 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:40.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:40.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.560 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:40.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:40.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.612 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:40.621 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:40.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:40.629 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.629 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:40.686 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:40.712 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.713 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:40.770 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:41.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:41.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.806 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:41.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:41.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.816 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:41.876 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:41.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:41.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.907 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:41.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:41.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.961 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:41.963 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.018 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:42.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:42.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.063 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:43.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:43.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.115 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:43.124 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:43.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:43.133 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.133 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:43.190 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:43.210 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.210 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:43.268 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:44.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:44.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:44.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:44.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.342 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:44.351 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:44.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:44.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.400 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:44.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:44.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.430 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:44.458 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.487 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:45.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:45.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.562 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:45.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:45.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.614 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:45.623 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:45.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:45.672 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.672 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:45.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:45.703 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.704 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:45.729 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.729 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.729 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.760 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.730 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:46.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:46.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.828 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:46.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:46.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.881 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:46.890 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:46.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:46.898 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.898 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:46.956 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:46.967 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.967 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:47.024 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.957 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:47.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:47.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:48.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:48.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.111 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:48.120 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:48.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:48.128 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.128 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:48.187 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:48.207 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.207 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:48.263 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:49.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:49.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.288 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:49.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:49.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.340 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:49.349 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:49.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:49.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.398 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:49.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:49.437 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.438 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:49.455 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.495 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.456 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:50.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:50.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:50.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:50.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.608 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:50.616 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:50.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:50.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.666 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:50.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:50.701 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.701 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:50.723 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.760 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.724 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:51.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:51.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.822 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:51.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:51.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.874 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:51.883 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:51.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:51.933 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.933 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:51.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:51.963 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.963 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:51.991 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.021 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.992 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:52.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:52.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.090 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:53.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:53.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.142 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:53.151 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:53.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:53.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.199 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:53.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:53.224 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.224 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:53.255 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.255 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.255 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.255 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.281 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.281 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.281 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.281 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.256 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:54.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:54.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.356 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:54.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:54.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.409 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:54.418 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:54.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:54.467 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.467 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:54.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:54.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.510 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:54.524 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.568 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.525 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:55.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:55.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.623 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:55.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:55.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.675 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:55.684 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:55.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:55.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.692 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:55.748 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:55.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.758 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:55.815 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.749 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:56.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:56.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:56.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:56.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.900 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:56.909 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:56.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:56.958 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.959 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:57.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:57.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.000 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:57.015 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.057 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.017 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:58.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:58.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:58.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:58.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.167 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:58.176 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:58.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:58.184 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.184 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:58.243 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:58.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.267 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:58.324 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.325 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.244 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:59.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:59.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.340 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:59.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:59.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.392 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:52:59.401 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:52:59.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:52:59.450 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.451 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:52:59.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:52:59.485 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.486 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:52:59.507 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.507 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.542 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.508 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:00.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:00.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:00.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:00.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.659 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:00.667 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:00.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:00.717 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.717 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:00.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:00.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.745 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:00.775 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.802 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.777 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:01.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:01.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.875 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:01.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:01.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.927 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:01.936 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:01.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:01.945 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.945 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:02.001 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:02.013 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.013 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:02.070 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:03.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:03.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:03.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:03.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.152 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:03.161 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:03.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:03.211 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.211 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:03.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:03.238 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.238 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:03.267 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.294 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.268 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:04.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:04.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:04.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:04.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.419 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:04.428 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:04.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:04.436 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.436 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:04.493 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:04.511 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.511 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:04.568 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.495 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:05.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:05.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.593 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:05.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:05.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.645 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:05.654 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:05.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:05.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.705 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:05.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:05.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.733 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:05.763 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.790 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.791 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.791 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.765 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:06.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:06.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.861 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:06.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:06.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.914 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:06.923 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:06.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:06.932 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.932 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:06.989 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:07.007 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.008 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:07.065 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.990 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:07.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:07.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:08.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:08.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.140 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:08.150 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:08.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:08.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.158 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:08.216 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:08.225 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.225 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:08.282 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:09.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:09.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:09.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:09.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.367 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:09.377 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:09.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:09.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.386 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:09.442 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:09.454 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.454 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:09.511 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:10.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:10.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.542 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:10.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:10.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.594 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:10.603 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:10.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:10.653 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.653 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:10.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:10.679 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.679 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:10.710 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.738 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.711 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:11.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:11.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.810 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:11.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:11.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.863 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:11.872 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:11.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:11.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.923 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:11.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:11.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.959 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:11.980 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.016 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.982 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:12.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:12.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.080 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:13.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:13.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.131 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:13.140 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:13.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:13.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.189 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:13.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:13.217 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.217 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:13.248 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.274 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.249 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:14.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:14.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.329 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:14.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:14.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.381 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:14.390 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:14.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:14.440 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.440 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:14.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:14.473 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.473 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:14.497 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.529 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.529 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.530 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.530 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.498 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:15.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:15.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.597 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:15.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:15.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.650 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:15.659 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:15.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:15.708 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.708 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:15.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:15.737 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.737 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:15.765 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.765 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.765 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.795 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.766 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:16.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:16.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:16.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:16.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.917 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:16.926 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:16.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:16.976 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.976 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:17.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:17.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.018 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:17.033 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.076 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.035 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:18.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:18.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:18.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:18.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.185 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:18.194 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:18.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:18.244 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.244 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:18.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:18.271 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.271 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:18.301 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.328 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.328 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.328 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.303 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:19.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:19.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:19.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:19.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.452 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:19.461 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:19.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:19.469 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.469 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:19.527 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:19.537 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.538 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:19.595 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.595 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.595 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.595 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:20.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:20.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.596 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:20.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:20.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.600 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:20.657 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:20.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:20.671 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.671 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:20.728 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:20.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.736 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:20.792 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:21.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:21.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.828 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:21.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:21.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.888 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:21.897 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:21.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:21.946 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.946 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:21.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:21.968 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.968 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:22.004 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.025 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.005 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:23.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:23.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.105 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:23.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:23.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.116 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:23.167 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:23.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:23.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.190 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:23.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:23.246 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.246 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:23.248 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.302 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.303 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.303 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.249 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:24.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:24.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.346 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:24.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:24.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.398 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:24.407 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:24.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:24.456 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.457 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:24.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:24.487 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.487 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:24.514 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.514 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.514 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.514 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.544 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.515 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:25.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:25.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.614 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:25.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:25.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.666 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:25.675 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:25.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:25.724 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.724 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:25.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:25.756 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.756 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:25.781 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.812 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.812 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.812 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:26.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:26.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.882 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:26.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:26.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.933 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:26.942 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:26.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:26.991 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.991 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:27.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:27.026 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.026 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:27.048 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.048 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.048 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.048 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.083 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.048 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:28.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:28.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.147 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:28.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:28.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.200 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:28.209 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:28.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:28.217 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.217 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:28.275 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:28.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.295 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:28.351 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.276 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:29.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:29.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.375 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:29.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:29.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.426 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:29.435 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:29.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:29.485 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.485 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:29.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:29.524 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.524 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:29.544 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.582 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.582 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.582 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.545 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:30.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:30.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.644 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:30.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:30.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.696 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:30.705 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:30.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:30.755 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.755 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:30.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:30.784 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.784 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:30.811 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.840 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.812 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:31.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:31.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.863 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:31.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:31.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.915 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:31.924 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:31.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:31.974 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.974 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:32.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:32.009 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.009 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:32.031 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.065 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.032 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:33.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:33.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.130 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:33.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:33.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.183 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:33.192 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:33.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:33.201 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.201 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:33.257 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.257 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:33.270 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.270 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:33.327 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:34.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:34.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.328 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:34.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:34.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.336 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:34.392 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:34.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:34.417 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.417 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:34.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:34.466 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.466 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:34.473 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.473 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.524 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.524 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.474 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:35.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:35.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.575 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:35.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:35.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.628 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:35.637 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:35.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:35.646 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.646 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:35.704 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:35.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.717 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:35.774 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.705 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:36.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:36.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:36.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:36.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.854 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:36.863 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:36.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:36.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.872 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:36.929 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:36.937 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.937 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:36.994 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.930 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:37.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:37.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:38.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:38.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.059 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:38.068 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:38.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:38.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.118 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:38.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:38.140 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.140 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:38.175 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.197 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.176 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:39.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:39.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.275 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:39.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:39.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.328 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:39.337 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:39.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:39.345 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.346 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:39.403 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:39.427 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.427 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:39.485 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.404 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:40.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:40.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.502 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:40.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:40.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.555 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:40.564 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:40.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:40.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.572 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:40.629 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:40.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.649 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:40.706 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:41.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:41.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:41.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:41.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.780 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:41.789 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:41.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:41.841 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.841 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:41.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:41.872 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.872 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:41.897 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.928 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.898 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:42.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:42.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:42.998 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:42.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:42.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.051 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:43.060 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:43.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:43.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.110 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:43.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:43.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.134 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:43.167 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.167 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.190 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:44.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:44.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.268 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:44.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:44.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.320 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:44.329 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:44.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:44.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.378 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:44.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:44.419 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.420 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:44.434 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.476 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.436 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:45.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:45.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.536 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:45.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:45.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.588 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:45.597 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:45.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:45.646 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.646 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:45.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:45.670 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.670 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:45.703 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:45.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:45.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:45.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.727 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:45.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:45.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:45.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.705 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:46.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:46.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.757 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:46.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:46.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.808 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:46.817 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:46.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:46.867 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:46.868 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:46.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:46.887 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:46.888 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:46.924 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.945 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:47.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:47.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:47.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.025 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:48.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:48.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.077 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:48.086 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:48.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:48.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.136 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:48.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:48.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.177 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:48.193 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.194 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.194 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:48.234 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.194 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:49.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:49.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.293 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:49.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:49.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.346 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:49.355 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:49.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:49.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.363 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:49.420 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:49.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.440 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:49.497 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:50.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:50.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.520 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:50.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:50.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.570 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:50.579 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:50.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:50.630 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.630 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:50.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:50.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.658 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:50.687 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.715 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:51.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:51.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:51.788 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:51.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:51.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:51.840 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:51.849 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:51.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:51.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:51.858 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:51.915 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:51.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:51.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:51.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:51.937 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:51.937 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:51.994 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:51.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:51.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:51.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:52.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:52.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:52.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:53.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:53.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.067 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:53.076 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:53.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:53.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.127 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:53.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:53.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.150 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:53.185 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:53.208 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.208 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:54.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:54.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.284 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:54.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:54.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.336 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:54.345 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:54.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:54.395 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.395 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:54.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:54.422 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.423 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:54.452 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.479 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.454 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:55.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:55.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:55.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:55.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.603 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:55.612 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:55.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:55.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.662 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:55.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:55.685 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.685 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:55.719 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.720 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.742 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:56.721 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:56.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:56.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:56.819 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:56.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:56.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:56.871 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:56.880 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:56.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:56.889 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:56.889 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:56.945 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:56.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:56.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:56.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:56.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:56.956 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:56.957 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:57.014 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:57.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:57.015 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:57.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:57.947 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:57.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:57.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.046 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:58.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:58.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.098 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:58.107 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:58.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:58.115 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.115 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:58.172 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:58.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:58.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.182 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:58.239 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.173 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:59.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:59.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.271 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:59.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:59.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.324 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:53:59.333 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:53:59.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:53:59.382 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.383 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:53:59.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:53:59.414 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.414 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:53:59.439 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.470 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:00.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:00.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.539 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:00.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:00.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.592 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:00.602 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:00.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:00.610 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.610 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:00.667 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:00.680 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.680 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:00.738 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:01.668 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:01.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:01.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.767 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:01.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:01.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.819 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:01.828 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:01.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:01.837 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:01.837 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:01.895 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:01.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:01.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:01.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:01.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:01.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:01.908 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:01.965 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:01.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:01.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:01.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:02.896 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:02.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:02.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:02.993 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:02.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:02.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.045 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:03.054 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:03.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:03.062 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.062 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:03.119 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.119 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.119 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:03.131 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.131 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:03.188 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.120 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:04.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:04.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.218 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:04.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:04.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.270 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:04.280 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:04.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:04.288 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.288 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:04.347 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.347 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.347 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:04.364 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.364 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:04.422 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.349 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:05.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:05.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:05.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:05.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.499 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:05.508 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:05.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:05.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.517 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:05.573 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:05.583 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.583 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:05.640 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.575 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:06.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:06.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.673 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:06.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:06.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.725 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:06.734 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:06.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:06.783 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.783 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:06.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:06.808 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.808 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:06.839 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.865 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:07.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:07.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:07.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:07.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.989 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:07.999 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:08.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:08.007 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.007 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:08.066 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:08.083 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.083 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:08.140 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:09.067 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:09.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:09.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:09.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:09.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:09.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:09.218 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:09.227 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:09.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:09.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.278 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:09.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:09.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.300 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:09.335 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:09.356 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.336 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:10.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:10.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.435 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:10.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:10.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.487 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:10.496 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:10.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:10.504 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.504 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:10.562 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.562 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:10.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.581 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:10.639 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.564 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:11.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:11.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.662 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:11.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:11.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.714 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:11.724 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:11.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:11.732 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.732 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:11.788 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:11.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.802 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:11.860 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:12.790 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:12.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:12.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.888 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:12.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:12.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.941 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:12.949 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:13.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:13.000 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:13.000 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:13.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:13.027 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:13.027 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:13.057 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:13.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:13.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:13.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:13.083 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:13.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:13.084 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:13.084 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:14.058 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:14.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:14.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:14.117 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:14.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:14.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:14.169 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:14.178 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:14.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:14.226 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.226 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:14.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:14.253 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.253 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:14.283 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:14.311 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.311 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.311 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.311 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.284 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:15.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:15.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.354 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:15.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:15.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.406 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:15.415 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:15.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:15.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.464 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:15.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:15.498 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.498 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:15.522 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.555 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.523 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:16.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:16.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:16.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:16.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.640 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:16.649 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:16.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:16.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.660 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:16.717 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:16.723 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.723 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:16.780 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:17.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:17.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.818 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:17.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:17.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.897 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:17.906 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:17.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:17.916 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.916 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:17.973 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:17.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:17.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:17.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:17.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.982 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:18.039 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:18.039 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.039 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:18.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:18.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:18.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:18.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:19.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:19.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:19.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:19.113 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:19.123 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:19.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:19.174 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.174 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:19.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:19.192 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.192 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:19.231 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:19.250 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.232 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:20.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:20.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.332 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:20.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:20.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.385 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:20.395 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:20.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:20.402 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.402 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:20.459 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:20.481 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.481 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:20.538 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.538 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:21.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:21.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:21.559 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:21.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:21.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:21.611 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:21.621 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:21.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:21.671 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.671 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:21.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:21.703 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.703 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:21.728 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.759 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:22.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:22.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.817 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:22.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:22.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.868 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:22.877 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:22.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:22.886 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.886 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:22.942 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:22.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:22.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:22.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:22.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.953 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:23.009 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:23.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:23.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:23.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:23.943 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:23.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:23.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:24.043 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:24.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:24.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:24.095 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:24.104 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:24.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:24.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.112 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:24.169 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:24.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:24.183 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.183 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:24.239 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.240 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.240 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:25.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:25.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.238 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:25.241 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:25.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:25.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.303 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:25.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:25.312 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.312 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:25.369 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.370 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:25.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.376 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:25.434 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:26.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:26.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:26.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:26.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:26.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:26.496 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:26.506 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:26.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:26.514 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.515 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:26.572 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:26.595 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.595 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:26.651 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.651 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.651 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:27.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:27.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:27.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:27.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.725 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:27.735 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:27.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:27.743 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.743 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:27.799 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:27.823 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.823 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:27.880 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:28.801 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:28.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:28.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:28.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:28.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.887 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:28.962 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:28.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:28.969 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:28.969 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:29.026 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:29.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:29.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.054 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:29.112 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.027 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:30.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:30.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:30.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:30.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.173 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:30.182 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:30.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:30.232 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.232 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:30.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:30.258 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.258 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:30.289 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.289 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.315 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.315 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.315 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.290 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:31.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:31.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:31.388 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:31.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:31.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:31.444 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:31.453 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:31.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:31.502 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:31.502 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:31.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:31.537 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:31.537 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:31.559 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:31.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:31.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:31.559 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.596 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:31.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:31.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:31.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:32.560 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:32.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:32.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.658 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:32.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:32.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.711 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:32.720 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:32.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:32.728 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.728 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:32.786 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.786 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:32.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:32.799 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.800 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:32.857 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:33.787 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:33.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:33.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:33.886 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:33.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:33.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:33.938 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:33.947 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:33.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:33.996 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:33.996 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:34.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:34.020 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.020 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:34.056 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:34.077 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.078 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.078 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.057 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:35.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:35.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:35.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:35.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.208 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:35.217 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:35.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:35.225 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.225 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:35.283 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:35.308 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.308 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:35.365 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.284 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:36.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:36.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:36.385 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:36.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:36.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:36.437 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:36.447 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:36.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:36.455 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:36.455 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:36.512 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:36.512 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:36.512 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:36.512 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:36.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:36.537 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:36.593 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:36.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:36.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:36.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:37.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:37.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:37.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.612 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:37.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:37.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.665 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:37.674 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:37.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:37.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.682 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:37.739 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:37.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:37.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:37.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:37.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:37.750 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.751 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:37.808 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:37.808 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:37.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:37.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:38.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:38.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:38.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:38.839 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:38.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:38.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:38.891 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:38.901 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:38.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:38.909 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:38.909 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:38.967 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:38.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:38.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:38.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:38.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:38.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:38.989 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:39.045 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:39.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:39.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:39.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:39.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:39.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:40.066 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:40.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:40.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:40.118 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:40.128 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:40.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:40.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:40.136 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:40.192 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:40.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:40.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:40.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:40.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:40.204 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:40.205 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:40.261 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:40.262 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:40.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:40.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:41.194 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:41.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:41.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:41.293 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:41.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:41.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:41.346 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:41.355 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:41.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:41.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:41.365 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:41.423 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:41.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:41.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:41.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:41.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:41.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:41.430 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:41.487 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:41.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:41.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:41.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:42.424 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:42.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:42.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:42.524 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:42.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:42.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:42.576 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:42.584 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:42.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:42.635 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:42.635 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:42.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:42.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:42.674 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:42.692 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:42.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:42.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:42.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:42.731 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:42.731 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:42.731 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:42.731 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:43.694 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:43.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:43.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:43.793 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:43.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:43.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:43.845 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:43.854 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:43.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:43.903 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:43.903 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:43.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:43.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:43.930 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:43.960 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:43.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:43.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:43.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:43.987 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:43.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:43.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:43.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:44.962 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:44.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:44.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:45.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:45.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:45.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:45.113 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:45.122 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:45.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:45.132 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:45.132 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:45.189 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:45.189 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:45.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:45.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:45.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:45.211 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:45.212 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:45.268 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:45.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:45.269 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:45.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:46.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:46.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:46.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:46.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:46.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:46.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:46.342 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:46.351 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:46.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:46.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:46.400 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:46.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:46.428 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:46.428 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:46.457 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:46.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:46.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:46.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:46.485 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:46.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:46.485 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:46.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:47.458 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:47.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:47.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:47.557 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:47.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:47.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:47.610 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:47.618 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:47.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:47.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:47.627 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:47.683 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:47.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:47.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:47.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:47.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:47.693 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:47.693 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:47.750 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:47.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:47.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:47.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:48.685 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:48.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:48.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:48.792 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:48.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:48.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:48.860 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:48.869 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:48.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:48.877 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:48.877 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:48.935 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:48.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:48.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:48.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:48.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:48.942 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:48.943 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:48.999 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:48.999 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:48.999 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:48.999 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:49.936 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:49.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:49.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.034 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:50.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:50.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.087 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:50.096 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:50.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:50.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.104 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:50.161 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:50.171 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.172 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:50.229 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:51.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:51.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.262 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:51.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:51.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.314 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:51.323 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:51.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:51.372 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.372 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:51.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:51.406 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.406 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:51.428 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.429 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.462 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.429 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:52.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:52.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:52.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:52.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.608 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:52.616 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:52.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:52.625 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:52.625 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:52.682 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:52.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:52.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:52.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:52.694 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:52.694 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:52.752 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:52.752 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:52.752 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:52.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:53.683 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:53.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:53.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:53.783 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:53.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:53.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:53.835 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:53.845 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:53.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:53.895 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:53.895 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:53.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:53.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:53.930 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:53.952 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:53.952 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:53.952 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:53.952 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:53.987 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:53.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:53.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:53.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:54.953 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:54.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:54.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.051 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:55.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:55.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.103 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:55.112 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:55.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:55.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.121 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:55.177 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:55.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.189 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:55.246 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.179 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:56.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:56.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.277 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:56.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:56.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.329 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:56.338 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:56.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:56.387 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.387 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:56.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:56.421 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.421 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:56.445 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.445 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.445 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.479 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.479 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:57.446 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:57.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:57.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:57.547 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:57.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:57.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:57.604 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:57.613 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:57.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:57.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:57.622 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:57.678 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:57.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:57.679 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:57.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:57.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:57.690 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:57.690 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:57.747 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:57.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:57.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:57.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:58.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:58.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:58.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:58.779 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:58.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:58.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:58.832 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:54:58.841 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:54:58.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:58.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:58.850 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:54:58.907 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:58.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:58.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:58.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:58.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:54:58.918 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:58.919 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:54:58.976 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:58.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:58.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:58.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:59.908 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:59.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:54:59.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:00.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:00.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.059 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:00.069 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:00.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:00.077 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.077 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:00.135 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:00.143 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.144 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:00.201 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.136 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:01.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:01.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:01.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:01.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.285 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:01.294 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:01.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:01.303 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.303 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:01.360 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:01.369 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.369 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:01.426 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:02.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:02.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:02.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.429 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:02.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:02.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.435 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:02.497 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:02.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:02.515 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:02.515 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:02.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:02.571 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:02.571 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:02.572 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:02.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:02.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:02.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:02.628 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:02.628 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:02.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:02.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:03.573 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:03.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:03.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:03.673 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:03.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:03.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:03.725 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:03.735 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:03.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:03.743 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:03.743 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:03.800 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:03.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:03.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:03.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:03.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:03.808 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:03.808 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:03.866 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:03.866 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:03.866 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:03.867 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:04.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:04.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:04.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:04.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:04.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:04.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:04.953 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:04.962 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:04.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:04.970 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.970 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:05.026 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:05.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.050 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:05.107 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.027 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:06.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:06.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.097 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:06.109 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:06.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:06.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.173 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:06.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:06.183 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.183 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:06.240 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.241 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.241 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:06.255 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.255 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:06.312 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:07.242 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:07.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:07.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:07.340 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:07.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:07.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:07.391 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:07.400 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:07.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:07.450 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:07.451 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:07.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:07.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:07.483 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:07.507 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:07.507 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:07.507 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:07.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:07.540 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:07.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:07.540 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:07.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:08.508 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:08.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:08.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:08.607 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:08.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:08.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:08.659 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:08.669 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:08.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:08.718 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:08.718 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:08.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:08.743 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:08.743 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:08.775 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:08.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:08.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:08.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:08.800 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:08.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:08.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:08.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:09.776 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:09.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:09.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.874 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:09.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:09.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.926 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:09.935 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:09.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:09.943 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.943 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:10.000 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:10.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.019 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:10.077 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.078 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.078 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.002 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:11.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:11.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:11.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:11.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.152 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:11.161 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:11.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:11.170 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:11.170 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:11.227 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:11.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:11.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:11.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.249 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:11.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:11.249 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:11.307 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:11.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:11.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:11.307 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:12.228 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:12.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:12.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:12.327 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:12.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:12.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:12.379 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:12.388 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:12.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:12.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.438 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:12.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:12.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.461 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:12.495 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:12.518 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.519 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.519 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.519 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.497 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:13.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:13.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:13.596 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:13.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:13.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:13.649 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:13.658 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:13.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:13.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:13.666 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:13.723 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:13.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:13.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:13.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:13.737 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:13.738 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:13.794 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:13.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:13.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:13.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:14.724 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:14.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:14.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:14.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:14.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.874 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:14.883 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:14.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:14.932 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.932 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:14.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:14.963 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.963 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:14.989 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.020 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.020 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.990 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:15.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:15.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:16.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:16.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.141 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:16.150 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:16.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:16.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:16.158 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:16.214 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:16.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:16.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:16.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:16.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:16.233 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:16.234 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:16.290 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:16.290 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:16.291 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:16.291 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:17.215 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:17.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:17.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:17.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:17.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:17.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:17.364 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:17.373 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:17.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:17.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.423 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:17.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:17.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.446 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:17.481 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:17.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:17.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:17.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:17.503 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:17.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:17.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:17.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.483 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:18.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:18.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:18.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:18.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:18.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:18.632 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:18.641 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:18.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:18.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:18.692 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:18.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:18.719 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:18.719 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:18.749 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.776 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.776 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.776 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.776 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:19.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:19.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.853 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:19.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:19.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.905 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:19.914 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:19.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:19.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.922 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:19.980 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:19.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.998 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:20.055 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.055 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.981 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:20.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:20.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.080 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:21.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:21.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.131 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:21.140 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:21.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:21.191 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:21.191 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:21.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:21.231 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:21.231 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:21.248 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:21.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:21.248 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:21.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:21.288 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:21.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:21.289 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:21.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:22.249 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:22.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:22.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:22.348 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:22.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:22.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:22.401 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:22.410 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:22.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:22.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:22.420 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:22.476 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:22.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:22.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:22.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:22.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:22.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:22.496 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:22.553 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:22.554 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:22.554 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:22.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.477 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:23.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:23.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:23.576 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:23.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:23.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:23.629 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:23.638 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:23.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:23.646 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.646 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:23.704 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:23.718 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.718 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:23.775 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.776 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.776 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.776 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.705 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:24.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:24.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.804 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:24.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:24.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.857 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:24.866 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:24.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:24.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.874 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:24.931 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:24.944 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.945 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:25.002 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.003 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.003 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.932 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:25.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:25.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.029 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:26.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:26.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.081 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:26.090 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:26.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:26.099 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:26.099 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:26.155 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:26.156 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:26.156 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:26.156 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:26.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:26.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:26.173 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:26.230 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:26.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:26.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:26.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:27.157 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:27.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:27.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:27.254 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:27.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:27.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:27.306 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:27.315 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:27.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:27.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:27.365 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:27.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:27.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:27.391 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:27.422 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:27.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:27.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:27.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:27.448 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:27.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:27.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:27.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.424 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:28.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:28.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:28.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:28.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.535 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:28.544 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:28.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:28.552 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.552 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:28.609 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.609 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.609 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:28.618 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.618 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:28.675 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.675 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:29.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:29.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.710 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:29.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:29.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.763 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:29.772 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:29.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:29.781 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.781 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:29.837 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:29.860 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.860 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:29.917 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.838 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:30.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:30.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:30.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:30.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.988 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:30.997 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:31.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:31.047 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:31.047 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:31.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:31.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:31.071 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:31.103 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:31.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:31.103 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:31.103 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:31.127 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:31.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:31.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:31.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:32.104 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:32.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:32.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:32.202 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:32.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:32.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:32.255 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:32.264 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:32.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:32.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:32.273 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:32.329 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:32.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:32.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:32.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:32.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:32.335 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:32.336 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:32.394 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:32.394 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:32.394 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:32.394 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.330 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:33.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:33.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.428 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:33.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:33.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.481 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:33.490 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:33.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:33.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.499 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:33.556 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:33.571 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.571 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:33.628 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.557 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:34.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:34.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.656 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:34.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:34.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.708 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:34.717 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:34.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:34.768 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.769 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:34.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:34.799 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.799 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:34.825 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.825 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.825 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.857 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.826 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:35.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:35.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:35.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:35.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.978 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:35.987 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:36.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:36.036 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:36.036 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:36.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:36.061 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:36.061 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:36.093 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:36.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:36.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:36.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:36.117 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:36.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:36.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:36.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:37.094 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:37.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:37.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:37.194 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:37.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:37.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:37.250 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:37.259 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:37.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:37.306 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.307 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:37.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:37.339 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.339 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:37.365 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:37.396 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.367 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:38.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:38.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:38.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:38.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.519 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:38.528 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:38.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:38.576 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.576 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:38.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:38.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.608 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:38.634 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.634 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.665 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.635 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:39.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:39.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:39.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:39.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.788 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:39.797 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:39.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:39.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.847 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:39.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:39.876 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.876 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:39.903 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.933 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.904 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:40.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:40.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:40.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:40.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:41.021 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:41.030 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:41.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:41.079 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:41.080 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:41.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:41.114 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:41.114 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:41.136 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:41.137 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:41.137 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:41.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:41.171 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:41.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:41.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:41.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:42.138 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:42.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:42.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:42.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:42.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:42.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:42.290 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:42.299 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:42.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:42.307 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.308 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:42.365 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.365 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.365 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:42.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:42.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.376 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:42.434 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.366 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:43.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:43.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.464 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:43.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:43.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.516 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:43.525 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:43.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:43.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.572 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:43.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:43.597 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.597 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:43.629 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.654 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.630 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:44.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:44.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.729 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:44.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:44.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.782 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:44.791 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:44.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:44.799 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.799 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:44.856 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.857 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.857 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:44.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.873 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:44.930 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:45.857 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:45.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:45.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.956 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:45.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:45.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:46.009 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:46.018 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:46.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:46.026 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:46.026 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:46.082 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:46.083 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:46.083 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:46.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:46.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:46.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:46.091 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:46.148 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:46.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:46.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:46.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.084 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:47.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:47.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.182 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:47.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:47.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.235 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:47.244 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:47.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:47.294 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.294 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:47.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:47.322 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.322 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:47.351 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.351 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.379 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.352 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:48.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:48.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.452 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:48.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:48.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.504 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:48.513 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:48.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:48.564 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.565 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:48.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:48.598 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.599 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:48.621 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.655 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.623 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:49.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:49.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.721 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:49.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:49.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.774 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:49.783 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:49.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:49.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.832 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:49.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:49.857 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.857 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:49.889 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.914 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:50.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:50.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:50.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:50.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:50.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:51.066 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:51.075 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:51.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:51.084 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:51.084 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:51.141 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:51.141 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:51.141 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:51.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:51.152 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:51.152 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:51.209 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:51.209 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:51.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:51.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.142 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:52.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:52.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.262 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:52.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:52.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.274 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:52.333 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:52.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:52.351 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.351 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:52.409 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:52.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.411 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:52.468 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:53.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:53.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.472 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:53.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:53.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.524 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:53.533 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:53.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:53.583 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.583 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:53.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:53.616 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.616 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:53.641 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.673 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.642 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:54.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:54.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:54.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:54.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.754 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:54.763 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:54.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:54.811 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.811 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:54.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:54.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.838 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:54.868 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.894 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:55.869 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:55.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:55.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.967 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:55.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:55.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:56.019 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:56.028 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:56.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:56.078 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:56.078 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:56.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:56.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:56.115 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:56.135 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:56.171 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.172 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.172 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.137 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:57.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:57.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.236 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:57.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:57.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.288 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:57.297 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:57.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:57.348 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.348 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:57.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:57.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.377 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:57.405 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.433 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.406 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:58.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:58.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.504 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:58.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:58.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.556 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:58.565 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:58.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:58.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.616 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:58.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:58.638 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.638 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:58.672 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.695 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:59.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:59.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:59.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:59.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.826 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:55:59.835 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:55:59.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:55:59.843 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:59.843 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:55:59.901 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:59.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:59.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:59.901 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:55:59.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:59.910 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:55:59.967 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:59.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:59.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:59.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:00.902 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:00.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:00.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:01.002 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:01.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:01.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:01.054 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:01.063 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:01.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:01.072 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:01.072 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:01.130 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:01.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:01.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:01.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:01.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:01.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:01.139 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:01.195 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:01.195 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:01.195 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:01.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:02.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:02.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:02.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:02.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.283 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:02.292 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:02.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:02.301 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:02.301 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:02.357 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:02.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:02.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:02.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:02.374 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:02.374 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:02.431 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:02.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:02.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:02.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.358 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:03.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:03.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.455 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:03.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:03.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.507 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:03.516 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:03.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:03.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:03.566 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:03.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:03.603 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:03.603 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:03.623 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:03.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:03.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:03.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.661 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:03.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:03.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:03.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:04.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:04.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.726 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:04.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:04.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.779 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:04.788 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:04.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:04.796 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:04.796 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:04.853 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:04.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:04.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:04.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:04.876 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:04.876 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:04.934 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:04.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:04.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:04.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:05.854 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:05.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:05.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.953 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:05.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:05.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:06.006 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:06.015 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:06.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:06.024 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:06.024 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:06.080 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:06.081 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:06.081 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:06.081 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:06.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:06.100 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:06.100 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:06.158 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:06.158 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:06.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:06.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.082 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:07.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:07.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.168 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:07.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:07.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.219 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:07.228 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:07.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:07.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:07.277 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:07.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:07.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:07.306 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:07.335 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:07.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:07.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:07.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.363 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:07.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:07.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:07.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.336 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:08.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:08.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.433 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:08.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:08.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.485 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:08.494 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:08.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:08.545 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:08.545 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:08.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:08.570 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:08.570 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:08.602 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:08.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:08.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:08.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.628 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:08.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:08.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:08.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.603 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:09.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:09.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:09.703 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:09.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:09.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:09.754 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:09.763 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:09.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:09.772 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:09.772 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:09.829 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:09.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:09.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:09.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:09.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:09.840 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:09.897 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:09.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:09.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:09.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:10.830 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:10.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:10.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.928 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:10.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:10.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.981 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:10.990 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:10.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:10.999 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:10.999 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:11.056 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:11.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:11.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:11.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:11.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:11.064 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:11.064 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:11.121 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:11.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:11.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:11.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.057 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:12.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:12.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.155 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:12.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:12.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.208 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:12.217 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:12.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:12.266 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:12.267 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:12.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:12.298 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:12.298 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:12.324 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:12.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:12.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:12.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.356 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:12.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:12.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:12.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.326 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:13.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:13.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.425 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:13.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:13.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.478 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:13.487 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:13.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:13.496 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:13.496 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:13.552 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:13.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:13.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:13.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:13.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:13.564 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:13.621 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:13.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:13.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:13.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.554 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:14.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:14.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:14.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:14.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:14.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:14.692 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:14.701 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:14.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:14.750 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:14.750 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:14.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:14.776 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:14.776 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:14.808 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:14.808 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:14.808 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:14.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.834 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:14.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:14.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:14.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:15.810 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:15.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:15.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.910 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:15.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:15.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.962 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:15.971 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:15.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:15.979 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:15.979 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:16.037 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:16.037 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:16.038 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:16.038 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:16.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:16.046 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:16.046 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:16.103 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:16.103 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:16.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:16.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.038 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:17.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:17.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.129 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:17.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:17.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.181 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:17.190 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:17.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:17.240 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:17.240 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:17.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:17.262 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:17.262 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:17.297 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:17.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:17.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:17.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.320 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:17.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:17.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:17.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.299 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:18.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:18.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.400 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:18.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:18.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.453 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:18.462 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:18.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:18.470 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:18.470 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:18.527 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:18.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:18.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:18.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:18.541 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:18.541 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:18.597 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:18.597 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:18.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:18.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.528 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:19.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:19.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:19.627 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:19.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:19.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:19.679 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:19.688 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:19.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:19.737 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:19.738 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:19.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:19.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:19.764 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:19.795 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:19.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:19.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:19.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.823 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:19.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:19.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:19.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:20.796 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:20.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:20.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.896 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:20.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:20.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.948 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:20.957 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:21.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:21.006 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:21.006 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:21.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:21.035 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:21.035 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:21.063 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:21.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:21.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:21.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.092 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:21.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:21.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:21.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.064 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:22.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:22.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.163 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:22.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.215 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:22.224 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:22.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:22.274 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:22.274 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:22.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:22.299 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:22.300 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:22.330 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:22.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:22.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:22.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.356 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:22.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:22.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:22.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:23.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:23.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.431 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:23.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:23.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.483 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:23.492 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:23.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:23.501 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:23.501 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:23.558 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:23.558 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:23.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:23.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:23.567 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:23.567 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:23.624 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:23.625 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:23.625 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:23.625 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.558 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:24.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:24.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:24.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:24.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.710 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:24.719 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:24.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:24.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:24.727 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:24.785 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:24.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:24.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:24.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:24.793 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:24.793 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:24.849 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:24.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:24.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:24.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:25.786 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:25.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:25.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:25.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:25.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.936 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:25.945 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:25.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:25.995 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:25.995 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:26.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:26.031 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:26.031 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:26.054 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:26.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:26.054 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:26.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.087 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:26.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:26.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:26.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.055 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:27.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:27.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:27.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:27.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.208 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:27.217 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:27.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:27.226 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:27.226 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:27.283 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:27.283 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:27.283 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:27.283 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:27.294 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:27.294 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:27.353 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:27.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:27.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:27.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.283 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:28.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:28.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:28.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:28.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.434 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:28.443 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:28.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:28.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:28.493 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:28.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:28.527 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:28.528 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:28.549 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:28.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:28.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:28.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.584 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:28.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:28.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:28.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.550 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:29.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:29.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:29.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:29.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.661 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:29.670 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:29.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:29.719 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:29.719 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:29.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:29.748 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:29.748 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:29.777 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:29.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:29.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:29.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.804 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:29.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:29.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:29.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:30.777 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:30.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:30.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:30.877 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:30.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:30.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:30.929 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:30.939 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:30.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:30.947 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:30.947 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:31.004 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:31.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:31.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:31.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:31.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:31.010 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:31.066 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:31.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:31.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:31.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.005 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:32.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:32.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.104 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:32.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:32.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.156 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:32.165 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:32.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:32.174 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:32.174 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:32.231 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:32.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:32.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:32.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.252 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:32.252 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:32.252 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:32.310 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:32.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:32.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:32.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.233 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:33.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:33.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.331 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:33.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:33.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.383 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:33.393 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:33.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:33.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:33.400 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:33.458 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:33.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:33.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:33.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:33.478 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:33.478 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:33.536 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:33.536 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:33.536 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:33.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.459 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:34.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:34.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.557 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:34.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:34.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.608 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:34.617 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:34.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:34.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:34.666 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:34.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:34.701 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:34.701 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:34.723 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:34.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:34.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:34.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.758 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:34.758 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:34.758 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:34.758 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.724 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:35.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:35.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:35.822 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:35.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:35.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:35.875 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:35.884 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:35.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:35.893 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:35.893 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:35.950 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:35.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:35.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:35.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:35.964 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:35.964 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:36.021 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:36.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:36.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:36.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.950 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:36.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:36.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:37.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:37.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.099 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:37.108 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:37.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:37.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:37.159 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:37.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:37.194 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:37.194 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:37.216 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:37.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:37.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:37.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:37.250 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:37.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:37.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:37.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:38.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:38.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:38.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:38.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.368 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:38.377 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:38.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:38.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:38.428 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:38.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:38.467 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:38.467 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:38.485 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:38.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:38.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:38.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.525 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:38.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:38.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:38.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.487 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:39.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:39.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:39.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:39.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.642 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:39.651 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:39.700 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:39.701 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:39.701 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:39.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:39.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:39.733 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:39.759 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:39.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:39.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:39.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.790 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:39.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:39.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:39.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.760 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:40.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:40.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.837 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:40.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:40.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.890 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:40.899 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:40.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:40.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:40.908 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:40.964 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:40.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:40.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:40.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:40.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:40.973 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:41.030 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:41.030 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:41.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:41.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.966 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:41.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:41.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:42.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:42.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.117 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:42.126 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:42.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:42.135 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:42.135 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:42.192 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:42.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:42.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:42.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:42.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:42.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:42.218 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:42.275 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:42.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:42.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:42.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:43.193 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:43.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:43.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:43.291 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:43.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:43.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:43.344 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:43.354 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:43.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:43.404 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:43.404 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:43.439 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:43.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:43.440 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:43.462 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:43.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:43.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:43.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:43.497 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:43.497 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:43.497 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:43.497 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:44.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:44.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.563 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:44.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:44.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.616 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:44.625 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:44.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:44.634 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:44.634 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:44.690 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:44.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:44.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:44.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:44.713 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:44.713 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:44.771 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:44.771 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:44.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:44.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:45.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:45.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:45.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:45.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.842 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:45.851 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:45.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:45.901 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:45.901 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:45.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:45.938 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:45.938 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:45.958 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:45.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:45.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:45.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.996 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:45.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:45.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:45.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:46.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:46.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:47.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:47.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.113 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:47.122 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:47.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:47.131 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:47.131 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:47.187 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:47.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:47.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:47.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:47.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:47.200 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:47.200 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:47.257 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:47.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:47.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:47.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:48.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:48.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:48.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:48.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:48.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.339 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:48.348 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:48.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:48.357 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:48.357 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:48.414 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:48.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:48.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:48.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:48.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:48.422 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:48.422 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:48.479 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:48.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:48.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:48.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:49.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:49.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.513 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:49.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:49.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.564 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:49.573 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:49.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:49.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:49.582 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:49.639 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:49.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:49.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:49.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:49.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:49.649 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:49.707 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:49.707 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:49.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:49.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:50.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:50.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.739 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:50.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:50.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.791 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:50.800 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:50.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:50.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:50.851 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:50.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:50.875 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:50.875 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:50.908 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:50.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:50.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:50.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.932 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:50.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:50.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:50.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:51.909 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:51.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:51.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:52.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:52.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:52.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:52.059 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T22:56:52.068 DEBUG:teuthology.orchestra.run.trial049:> true 2026-02-12T22:56:52.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T22:56:52.117 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:52.118 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T22:56:52.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial049.front.sepia.ceph.com' 2026-02-12T22:56:52.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:56:52.148 DEBUG:teuthology.orchestra.run.trial049:> uname -r 2026-02-12T22:56:52.174 INFO:teuthology.orchestra.run.trial082.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:52.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:52.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:52.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.175 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.176 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:56:52.190 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:56:52.224 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/no prefetch_oft_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:56:52.224 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:56:52.298 INFO:teuthology.orchestra.run.trial049.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:56:52.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:56:52.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:56:52.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.359 INFO:teuthology.run:FAIL