2026-02-12T22:01:49.850 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:01:49.869 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:01:49.952 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47114 branch: wip-pdonnell-testing-20260210.171210 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47114' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 global: ms die on skipped message: false mds: mds oft prefetch dirfrags: false mds_sleep_rank_change: 5000000.0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - Replacing daemon mds - SLOW_OPS - slow request sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: syntax: v2 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEgYf8otBYsfRFQ/S+o6/Dkwd/kPem8eJoOdzi087k/Ul35AGqFCuA6dfvx1eKN2JH/Nim06zlfM2I4HMGOg/s= trial127.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbsJsppu5DCKlolAQH7zUcRPC1tFHwPvvoyKy9JPvbq9LcUFqMdVUOwf2tDTZbbhrL0btnBrRU1d/rBd+JOhII= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: - /tank/home/pdonnell/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/suites/fs/thrash/workloads/mount/kclient/overrides/distro/testing/k-testing.yaml meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:01:49.952 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:01:49.952 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:01:49.952 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:01:49.954 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:01:49.954 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:01:49.954 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:01:49.954 INFO:teuthology.packaging:ref: None 2026-02-12T22:01:49.954 INFO:teuthology.packaging:tag: None 2026-02-12T22:01:49.954 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:01:49.954 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:01:49.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:01:50.069 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:01:50.070 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:01:50.081 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:01:50.081 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:01:50.095 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:01:50.111 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:01:50.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:01:50.197 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial119.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47114', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 21:58:26.634262', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNEgYf8otBYsfRFQ/S+o6/Dkwd/kPem8eJoOdzi087k/Ul35AGqFCuA6dfvx1eKN2JH/Nim06zlfM2I4HMGOg/s='} 2026-02-12T22:01:50.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial127.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47114', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 21:58:26.633669', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbsJsppu5DCKlolAQH7zUcRPC1tFHwPvvoyKy9JPvbq9LcUFqMdVUOwf2tDTZbbhrL0btnBrRU1d/rBd+JOhII='} 2026-02-12T22:01:50.252 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:01:50.267 INFO:teuthology.task.internal:roles: ubuntu@trial119.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:01:50.268 INFO:teuthology.task.internal:roles: ubuntu@trial127.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:01:50.268 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:01:50.402 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7921305cf240>, signals=[15]) 2026-02-12T22:01:50.402 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:01:50.413 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:01:50.413 DEBUG:teuthology.task.internal:connecting to ubuntu@trial119.front.sepia.ceph.com 2026-02-12T22:01:50.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:50.475 DEBUG:teuthology.task.internal:connecting to ubuntu@trial127.front.sepia.ceph.com 2026-02-12T22:01:50.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:50.536 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:01:50.548 DEBUG:teuthology.orchestra.run.trial119:> uname -m 2026-02-12T22:01:50.564 INFO:teuthology.orchestra.run.trial119.stdout:x86_64 2026-02-12T22:01:50.565 DEBUG:teuthology.orchestra.run.trial119:> cat /etc/os-release 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:NAME="Rocky Linux" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:ID="rocky" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_ID="10.1" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:ANSI_COLOR="0;32" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:01:50.621 INFO:teuthology.orchestra.run.trial119.stdout:VENDOR_NAME="RESF" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:01:50.622 INFO:teuthology.orchestra.run.trial119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:50.622 INFO:teuthology.lock.ops:Updating trial119.front.sepia.ceph.com on lock server 2026-02-12T22:01:50.693 DEBUG:teuthology.orchestra.run.trial127:> uname -m 2026-02-12T22:01:50.710 INFO:teuthology.orchestra.run.trial127.stdout:x86_64 2026-02-12T22:01:50.710 DEBUG:teuthology.orchestra.run.trial127:> cat /etc/os-release 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:NAME="Rocky Linux" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:ID="rocky" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:VERSION_ID="10.1" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:ANSI_COLOR="0;32" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:VENDOR_NAME="RESF" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:01:50.767 INFO:teuthology.orchestra.run.trial127.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:01:50.768 INFO:teuthology.orchestra.run.trial127.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:01:50.768 INFO:teuthology.orchestra.run.trial127.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:01:50.768 INFO:teuthology.orchestra.run.trial127.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:50.768 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:01:50.768 INFO:teuthology.orchestra.run.trial127.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:50.768 INFO:teuthology.lock.ops:Updating trial127.front.sepia.ceph.com on lock server 2026-02-12T22:01:50.848 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:01:50.860 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:01:50.872 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:01:50.872 DEBUG:teuthology.orchestra.run.trial119:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:01:50.874 DEBUG:teuthology.orchestra.run.trial127:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:01:50.891 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:01:50.902 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:01:50.902 DEBUG:teuthology.orchestra.run.trial119:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:01:50.930 DEBUG:teuthology.orchestra.run.trial127:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:01:50.945 INFO:teuthology.orchestra.run.trial119.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:01:50.948 INFO:teuthology.orchestra.run.trial127.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:01:50.949 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:01:51.116 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:01:51.135 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:01:51.135 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:01:51.136 DEBUG:teuthology.orchestra.run.trial119:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:01:51.136 DEBUG:teuthology.orchestra.run.trial127:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:01:51.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:01:51.152 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:01:51.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:01:51.152 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:01:51.209 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:51.209 INFO:teuthology.task.kernel:Running kernel on trial127: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:51.209 DEBUG:teuthology.orchestra.run.trial127:> sudo yum install -y kernel 2026-02-12T22:01:51.210 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:51.210 INFO:teuthology.task.kernel:Running kernel on trial119: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:51.210 DEBUG:teuthology.orchestra.run.trial119:> sudo yum install -y kernel 2026-02-12T22:01:51.721 INFO:teuthology.orchestra.run.trial119.stdout:Rocky Linux 10 - AppStream 20 MB/s | 2.2 MB 00:00 2026-02-12T22:01:51.738 INFO:teuthology.orchestra.run.trial127.stdout:Rocky Linux 10 - AppStream 18 MB/s | 2.2 MB 00:00 2026-02-12T22:01:52.035 INFO:teuthology.orchestra.run.trial119.stdout:Rocky Linux 10 - BaseOS 59 MB/s | 11 MB 00:00 2026-02-12T22:01:52.046 INFO:teuthology.orchestra.run.trial127.stdout:Rocky Linux 10 - BaseOS 60 MB/s | 11 MB 00:00 2026-02-12T22:01:52.541 INFO:teuthology.orchestra.run.trial127.stdout:Rocky Linux 10 - CRB 5.8 MB/s | 503 kB 00:00 2026-02-12T22:01:52.542 INFO:teuthology.orchestra.run.trial119.stdout:Rocky Linux 10 - CRB 5.2 MB/s | 503 kB 00:00 2026-02-12T22:01:53.603 INFO:teuthology.orchestra.run.trial127.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 6.2 MB 00:01 2026-02-12T22:01:53.866 INFO:teuthology.orchestra.run.trial119.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 6.2 MB 00:01 2026-02-12T22:01:54.253 INFO:teuthology.orchestra.run.trial127.stdout:lab-extras 282 kB/s | 3.7 kB 00:00 2026-02-12T22:01:54.523 INFO:teuthology.orchestra.run.trial119.stdout:lab-extras 314 kB/s | 3.7 kB 00:00 2026-02-12T22:01:54.673 INFO:teuthology.orchestra.run.trial127.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:01:54.685 INFO:teuthology.orchestra.run.trial127.stdout:Dependencies resolved. 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout: Package Arch Version Repo Size 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout:Installing: 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout:Installing dependencies: 2026-02-12T22:01:54.686 INFO:teuthology.orchestra.run.trial127.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout:Transaction Summary 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout:================================================================================ 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout:Install 5 Packages 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout:Total download size: 93 M 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout:Installed size: 135 M 2026-02-12T22:01:54.687 INFO:teuthology.orchestra.run.trial127.stdout:Downloading Packages: 2026-02-12T22:01:54.743 INFO:teuthology.orchestra.run.trial127.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-12T22:01:54.939 INFO:teuthology.orchestra.run.trial119.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:01:54.949 INFO:teuthology.orchestra.run.trial127.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 70 MB/s | 18 MB 00:00 2026-02-12T22:01:54.951 INFO:teuthology.orchestra.run.trial119.stdout:Dependencies resolved. 2026-02-12T22:01:54.951 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: Package Arch Version Repo Size 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout:Installing: 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout:Installing dependencies: 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-12T22:01:54.952 INFO:teuthology.orchestra.run.trial119.stdout:Transaction Summary 2026-02-12T22:01:54.953 INFO:teuthology.orchestra.run.trial119.stdout:================================================================================ 2026-02-12T22:01:54.953 INFO:teuthology.orchestra.run.trial119.stdout:Install 5 Packages 2026-02-12T22:01:54.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-12T22:01:54.953 INFO:teuthology.orchestra.run.trial119.stdout:Total download size: 93 M 2026-02-12T22:01:54.954 INFO:teuthology.orchestra.run.trial119.stdout:Installed size: 135 M 2026-02-12T22:01:54.954 INFO:teuthology.orchestra.run.trial119.stdout:Downloading Packages: 2026-02-12T22:01:55.006 INFO:teuthology.orchestra.run.trial127.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 49 MB/s | 2.8 MB 00:00 2026-02-12T22:01:55.015 INFO:teuthology.orchestra.run.trial119.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 22 MB/s | 1.4 MB 00:00 2026-02-12T22:01:55.220 INFO:teuthology.orchestra.run.trial127.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 62 MB/s | 30 MB 00:00 2026-02-12T22:01:55.281 INFO:teuthology.orchestra.run.trial119.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 56 MB/s | 18 MB 00:00 2026-02-12T22:01:55.381 INFO:teuthology.orchestra.run.trial119.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 28 MB/s | 2.8 MB 00:00 2026-02-12T22:01:55.421 INFO:teuthology.orchestra.run.trial127.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 55 MB/s | 41 MB 00:00 2026-02-12T22:01:55.422 INFO:teuthology.orchestra.run.trial127.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:01:55.422 INFO:teuthology.orchestra.run.trial127.stdout:Total 126 MB/s | 93 MB 00:00 2026-02-12T22:01:55.422 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction check 2026-02-12T22:01:55.433 INFO:teuthology.orchestra.run.trial119.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 71 MB/s | 30 MB 00:00 2026-02-12T22:01:55.493 INFO:teuthology.orchestra.run.trial119.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 75 MB/s | 41 MB 00:00 2026-02-12T22:01:55.494 INFO:teuthology.orchestra.run.trial119.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:01:55.494 INFO:teuthology.orchestra.run.trial119.stdout:Total 171 MB/s | 93 MB 00:00 2026-02-12T22:01:55.494 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction check 2026-02-12T22:01:55.569 INFO:teuthology.orchestra.run.trial127.stdout:Transaction check succeeded. 2026-02-12T22:01:55.569 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction test 2026-02-12T22:01:55.643 INFO:teuthology.orchestra.run.trial119.stdout:Transaction check succeeded. 2026-02-12T22:01:55.643 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction test 2026-02-12T22:01:55.970 INFO:teuthology.orchestra.run.trial127.stdout:Transaction test succeeded. 2026-02-12T22:01:55.970 INFO:teuthology.orchestra.run.trial127.stdout:Running transaction 2026-02-12T22:01:56.045 INFO:teuthology.orchestra.run.trial119.stdout:Transaction test succeeded. 2026-02-12T22:01:56.045 INFO:teuthology.orchestra.run.trial119.stdout:Running transaction 2026-02-12T22:01:56.664 INFO:teuthology.orchestra.run.trial127.stdout: Preparing : 1/1 2026-02-12T22:01:56.742 INFO:teuthology.orchestra.run.trial119.stdout: Preparing : 1/1 2026-02-12T22:01:56.868 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:01:56.889 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:56.944 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:01:56.966 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:58.154 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:58.183 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:01:58.215 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:58.243 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:02:00.030 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:02:00.035 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:02:00.091 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:02:00.097 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:02:01.893 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:02:01.902 INFO:teuthology.orchestra.run.trial127.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:01.959 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:02:01.969 INFO:teuthology.orchestra.run.trial119.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:03.763 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:03.832 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.489 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.512 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.560 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.581 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.745 INFO:teuthology.orchestra.run.trial127.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.745 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-12T22:02:37.745 INFO:teuthology.orchestra.run.trial127.stdout:Installed: 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-12T22:02:37.746 INFO:teuthology.orchestra.run.trial127.stdout:Complete! 2026-02-12T22:02:37.807 DEBUG:teuthology.orchestra.run.trial127:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:02:37.817 INFO:teuthology.orchestra.run.trial119.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:02:37.817 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout:Installed: 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-12T22:02:37.818 INFO:teuthology.orchestra.run.trial119.stdout:Complete! 2026-02-12T22:02:37.840 INFO:teuthology.orchestra.run.trial127.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.841 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.842 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.842 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:02:37.842 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:02:37.842 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:02:37.842 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial127.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:02:37.842 DEBUG:teuthology.orchestra.run.trial127:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:02:37.882 DEBUG:teuthology.orchestra.run.trial119:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:02:37.915 INFO:teuthology.orchestra.run.trial127.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.916 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.916 DEBUG:teuthology.orchestra.run.trial127:> sudo rpm -qi grub2-tools 2026-02-12T22:02:37.918 INFO:teuthology.orchestra.run.trial119.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.918 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.918 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.919 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:02:37.919 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:02:37.919 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:02:37.919 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial119.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:02:37.919 DEBUG:teuthology.orchestra.run.trial119:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:02:37.987 INFO:teuthology.orchestra.run.trial127.stdout:Name : grub2-tools 2026-02-12T22:02:37.987 INFO:teuthology.orchestra.run.trial127.stdout:Epoch : 1 2026-02-12T22:02:37.987 INFO:teuthology.orchestra.run.trial127.stdout:Version : 2.12 2026-02-12T22:02:37.987 INFO:teuthology.orchestra.run.trial127.stdout:Release : 29.el10_1 2026-02-12T22:02:37.987 INFO:teuthology.orchestra.run.trial127.stdout:Architecture: x86_64 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Group : Unspecified 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Size : 7963769 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:License : GPL-3.0-or-later 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Signature : 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Packager : Release Engineering 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:02:37.988 INFO:teuthology.orchestra.run.trial127.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:Summary : Support tools for GRUB. 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:Description : 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:hardware devices. 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout: 2026-02-12T22:02:37.989 INFO:teuthology.orchestra.run.trial127.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:02:37.990 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:02:37.990 INFO:teuthology.task.kernel:Updating grub on trial127 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.991 DEBUG:teuthology.orchestra.run.trial127:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:02:37.992 INFO:teuthology.orchestra.run.trial119.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.992 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.992 DEBUG:teuthology.orchestra.run.trial119:> sudo rpm -qi grub2-tools 2026-02-12T22:02:38.058 INFO:teuthology.orchestra.run.trial127.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:02:38.059 DEBUG:teuthology.orchestra.run.trial127:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Name : grub2-tools 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Epoch : 1 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Version : 2.12 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Release : 29.el10_1 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: x86_64 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Group : Unspecified 2026-02-12T22:02:38.064 INFO:teuthology.orchestra.run.trial119.stdout:Size : 7963769 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:License : GPL-3.0-or-later 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Signature : 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Packager : Release Engineering 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Summary : Support tools for GRUB. 2026-02-12T22:02:38.065 INFO:teuthology.orchestra.run.trial119.stdout:Description : 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout:hardware devices. 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-12T22:02:38.066 INFO:teuthology.orchestra.run.trial119.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:02:38.067 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:02:38.067 INFO:teuthology.task.kernel:Updating grub on trial119 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.068 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:02:38.126 INFO:teuthology.orchestra.run.trial127.stdout:/sbin/grubby 2026-02-12T22:02:38.128 INFO:teuthology.orchestra.run.trial127.stdout:yes 2026-02-12T22:02:38.128 DEBUG:teuthology.orchestra.run.trial127:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:02:38.134 INFO:teuthology.orchestra.run.trial119.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:02:38.135 DEBUG:teuthology.orchestra.run.trial119:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:02:38.195 INFO:teuthology.orchestra.run.trial127.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:02:38.196 DEBUG:teuthology.orchestra.run.trial127:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.201 INFO:teuthology.orchestra.run.trial119.stdout:/sbin/grubby 2026-02-12T22:02:38.203 INFO:teuthology.orchestra.run.trial119.stdout:yes 2026-02-12T22:02:38.203 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:02:38.269 INFO:teuthology.orchestra.run.trial119.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:02:38.271 DEBUG:teuthology.orchestra.run.trial119:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.274 DEBUG:teuthology.orchestra.run.trial127:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:02:38.347 DEBUG:teuthology.orchestra.run.trial119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:02:38.384 INFO:teuthology.orchestra.run.trial127.stderr:Generating grub configuration file ... 2026-02-12T22:02:38.458 INFO:teuthology.orchestra.run.trial119.stderr:Generating grub configuration file ... 2026-02-12T22:02:38.554 INFO:teuthology.orchestra.run.trial127.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:02:38.564 INFO:teuthology.orchestra.run.trial127.stderr:done 2026-02-12T22:02:38.565 DEBUG:teuthology.orchestra.run.trial127:> test -d /sys/firmware/efi 2026-02-12T22:02:38.582 DEBUG:teuthology.orchestra.run.trial127:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:02:38.634 INFO:teuthology.orchestra.run.trial119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:02:38.643 INFO:teuthology.orchestra.run.trial119.stderr:done 2026-02-12T22:02:38.645 DEBUG:teuthology.orchestra.run.trial119:> test -d /sys/firmware/efi 2026-02-12T22:02:38.655 INFO:teuthology.orchestra.run.trial127.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:02:38.655 INFO:teuthology.orchestra.run.trial127.stdout:/boot/efi/EFI/rocky 2026-02-12T22:02:38.657 DEBUG:teuthology.orchestra.run.trial127:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:02:38.662 DEBUG:teuthology.orchestra.run.trial119:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:02:38.724 INFO:teuthology.orchestra.run.trial127.stdout:no 2026-02-12T22:02:38.725 DEBUG:teuthology.orchestra.run.trial127:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:02:38.732 INFO:teuthology.orchestra.run.trial119.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:02:38.732 INFO:teuthology.orchestra.run.trial119.stdout:/boot/efi/EFI/rocky 2026-02-12T22:02:38.734 DEBUG:teuthology.orchestra.run.trial119:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:02:38.793 INFO:teuthology.orchestra.run.trial127.stdout:yes 2026-02-12T22:02:38.793 DEBUG:teuthology.orchestra.run.trial127:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:02:38.800 INFO:teuthology.orchestra.run.trial119.stdout:no 2026-02-12T22:02:38.801 DEBUG:teuthology.orchestra.run.trial119:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:02:38.861 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial127 2026-02-12T22:02:38.862 DEBUG:teuthology.orchestra.run.trial127:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:02:38.867 INFO:teuthology.orchestra.run.trial119.stdout:yes 2026-02-12T22:02:38.867 DEBUG:teuthology.orchestra.run.trial119:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:02:38.927 INFO:teuthology.orchestra.run.trial127.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:02:38.934 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial119 2026-02-12T22:02:38.934 DEBUG:teuthology.orchestra.run.trial119:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:02:38.998 INFO:teuthology.orchestra.run.trial119.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:03:08.904 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:08.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:08.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:09.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:09.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:09.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:09.043 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:09.101 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:09.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:09.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:09.118 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:09.175 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:09.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:09.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:09.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:09.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:09.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:09.186 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:09.243 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:09.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:09.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:09.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:10.179 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:10.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:10.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:10.305 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:10.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:10.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:10.359 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:10.369 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:10.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:10.376 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:10.376 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:10.434 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:10.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:10.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:10.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:10.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:10.459 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:10.459 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:10.517 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:10.517 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:10.517 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:10.517 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:11.435 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:11.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:11.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:11.555 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:11.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:11.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:11.608 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:11.618 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:11.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:11.625 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:11.625 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:11.682 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:11.682 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:11.682 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:11.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:11.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:11.694 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:11.694 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:11.751 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:11.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:11.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:11.752 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:12.683 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:12.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:12.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:12.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:12.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:12.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:12.834 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:12.844 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:12.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:12.893 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:12.893 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:12.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:12.927 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:12.927 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:12.949 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:12.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:12.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:12.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:12.984 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:12.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:12.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:12.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:13.951 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:13.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:13.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:14.050 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:14.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:14.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:14.102 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:14.112 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:14.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:14.162 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:14.162 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:14.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:14.197 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:14.197 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:14.218 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:14.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:14.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:14.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:14.253 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:14.253 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:14.253 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:14.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:15.219 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:15.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:15.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:15.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:15.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:15.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:15.369 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:15.379 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:15.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:15.427 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:15.428 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:15.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:15.455 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:15.455 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:15.484 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:15.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:15.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:15.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:15.511 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:15.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:15.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:15.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:16.485 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:16.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:16.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:16.588 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:16.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:16.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:16.640 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:16.651 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:16.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:16.699 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:16.700 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:16.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:16.725 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:16.725 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:16.756 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:16.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:16.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:16.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:16.782 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:16.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:16.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:16.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:17.758 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:17.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:17.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:17.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:17.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:17.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:17.909 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:17.919 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:17.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:17.968 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:17.968 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:18.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:18.006 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:18.006 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:18.025 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:18.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:18.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:18.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:18.063 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:18.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:18.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:18.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:19.027 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:19.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:19.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:19.126 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:19.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:19.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:19.178 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:19.188 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:19.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:19.236 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:19.236 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:19.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:19.272 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:19.273 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:19.294 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:19.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:19.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:19.294 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:19.330 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:19.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:19.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:19.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:20.295 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:20.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:20.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:20.394 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:20.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:20.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:20.446 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:20.457 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:20.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:20.505 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:20.505 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:20.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:20.528 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:20.528 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:20.562 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:20.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:20.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:20.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:20.585 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:20.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:20.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:20.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:21.564 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:21.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:21.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:21.662 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:21.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:21.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:21.715 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:21.725 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:21.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:21.774 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:21.775 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:21.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:21.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:21.797 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:21.832 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:21.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:21.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:21.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:21.854 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:21.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:21.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:21.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:22.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:22.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:22.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:22.932 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:22.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:22.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:22.985 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:22.995 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:23.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:23.043 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:23.043 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:23.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:23.070 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:23.070 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:23.101 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:23.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:23.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:23.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:23.128 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:23.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:23.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:23.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:24.102 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:24.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:24.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:24.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:24.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:24.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:24.239 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:24.249 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:24.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:24.298 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:24.299 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:24.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:24.338 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:24.338 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:24.356 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:24.356 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:24.356 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:24.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:24.395 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:24.395 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:24.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:24.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:25.357 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:25.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:25.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:25.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:25.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:25.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:25.508 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:25.518 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:25.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:25.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:25.566 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:25.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:25.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:25.602 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:25.623 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:25.623 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:25.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:25.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:25.659 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:25.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:25.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:25.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:26.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:26.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:26.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:26.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:26.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:26.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:26.775 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:26.785 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:26.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:26.833 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:26.834 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:26.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:26.864 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:26.864 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:26.890 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:26.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:26.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:26.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:26.921 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:26.921 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:26.921 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:26.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:27.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:27.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:27.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:27.991 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:27.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:27.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:28.043 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:28.053 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:28.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:28.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:28.102 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:28.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:28.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:28.134 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:28.159 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:28.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:28.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:28.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:28.191 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:28.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:28.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:28.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:29.160 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:29.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:29.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:29.259 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:29.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:29.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:29.311 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:29.328 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:29.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:29.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:29.335 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:29.393 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:29.393 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:29.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:29.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:29.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:29.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:29.409 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:29.465 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:29.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:29.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:29.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:30.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:30.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:30.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:30.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:30.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:30.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:30.545 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:30.601 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:30.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:30.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:30.608 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:30.665 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:30.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:30.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:30.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:30.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:30.689 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:30.689 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:30.746 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:30.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:30.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:30.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:31.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:31.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:31.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:31.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:31.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:31.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:31.818 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:31.829 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:31.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:31.836 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:31.836 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:31.893 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:31.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:31.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:31.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:31.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:31.914 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:31.914 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:31.971 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:31.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:31.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:31.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:32.894 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:32.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:32.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:32.993 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:32.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:32.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:33.045 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:33.056 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:33.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:33.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:33.104 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:33.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:33.130 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:33.130 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:33.160 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:33.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:33.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:33.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:33.186 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:33.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:33.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:33.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:34.161 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:34.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:34.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:34.261 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:34.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:34.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:34.313 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:34.324 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:34.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:34.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:34.331 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:34.388 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:34.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:34.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:34.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:34.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:34.405 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:34.405 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:34.462 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:34.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:34.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:34.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:35.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:35.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:35.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:35.489 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:35.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:35.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:35.540 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:35.551 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:35.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:35.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:35.598 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:35.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:35.635 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:35.635 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:35.654 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:35.655 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:35.655 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:35.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:35.692 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:35.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:35.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:35.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:36.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:36.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:36.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:36.754 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:36.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:36.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:36.806 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:36.817 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:36.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:36.863 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:36.863 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:36.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:36.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:36.890 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:36.921 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:36.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:36.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:36.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:36.946 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:36.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:36.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:36.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:37.923 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:37.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:37.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:38.022 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:38.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:38.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:38.074 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:38.085 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:38.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:38.133 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:38.133 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:38.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:38.167 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:38.167 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:38.190 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:38.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:38.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:38.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:38.223 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:38.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:38.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:38.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:39.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:39.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:39.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:39.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:39.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:39.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:39.347 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:39.359 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:39.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:39.366 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:39.366 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:39.424 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:39.424 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:39.424 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:39.424 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:39.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:39.438 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:39.438 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:39.495 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:39.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:39.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:39.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:40.425 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:40.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:40.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:40.527 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:40.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:40.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:40.580 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:40.591 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:40.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:40.598 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:40.599 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:40.655 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:40.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:40.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:40.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:40.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:40.678 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:40.678 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:40.735 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:40.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:40.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:40.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:41.657 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:41.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:41.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:41.721 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:41.736 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:41.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:41.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:41.798 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:41.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:41.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:41.805 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:41.862 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:41.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:41.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:41.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:41.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:41.874 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:41.874 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:41.931 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:41.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:41.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:41.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:42.863 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:42.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:42.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:42.962 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:42.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:42.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:43.015 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:43.025 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:43.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:43.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:43.074 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:43.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:43.112 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:43.112 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:43.130 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:43.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:43.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:43.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:43.169 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:43.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:43.170 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:43.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:44.132 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:44.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:44.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:44.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:44.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:44.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:44.283 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:44.293 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:44.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:44.341 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:44.341 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:44.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:44.369 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:44.369 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:44.398 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:44.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:44.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:44.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:44.426 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:44.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:44.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:44.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:45.400 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:45.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:45.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:45.498 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:45.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:45.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:45.551 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:45.561 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:45.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:45.611 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:45.611 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:45.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:45.637 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:45.637 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:45.668 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:45.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:45.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:45.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:45.695 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:45.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:45.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:45.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:46.670 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:46.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:46.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:46.768 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:46.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:46.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:46.821 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:46.832 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:46.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:46.879 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:46.879 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:46.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:46.913 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:46.913 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:46.937 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:46.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:46.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:46.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:46.971 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:46.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:46.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:46.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:47.938 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:47.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:47.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:48.037 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:48.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:48.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:48.089 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:48.100 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:48.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:48.148 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:48.148 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:48.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:48.176 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:48.176 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:48.206 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:48.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:48.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:48.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:48.233 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:48.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:48.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:48.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:49.207 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:49.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:49.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:49.305 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:49.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:49.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:49.357 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:49.368 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:49.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:49.375 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:49.376 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:49.432 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:49.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:49.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:49.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:49.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:49.454 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:49.454 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:49.511 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:49.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:49.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:49.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:50.434 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:50.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:50.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:50.532 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:50.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:50.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:50.585 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:50.595 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:50.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:50.644 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:50.644 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:50.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:50.680 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:50.680 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:50.700 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:50.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:50.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:50.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:50.737 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:50.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:50.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:50.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:51.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:51.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:51.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:51.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:51.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:51.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:51.853 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:51.863 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:51.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:51.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:51.912 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:51.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:51.937 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:51.938 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:51.968 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:51.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:51.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:51.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:51.994 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:51.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:51.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:51.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:52.970 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:52.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:52.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:53.068 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:53.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:53.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:53.120 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:53.130 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:53.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:53.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:53.179 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:53.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:53.217 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:53.217 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:53.236 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:53.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:53.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:53.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:53.274 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:53.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:53.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:53.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:54.237 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:54.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:54.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:54.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:54.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:54.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:54.386 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:54.396 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:54.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:54.444 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:54.444 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:54.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:54.480 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:54.480 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:54.502 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:54.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:54.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:54.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:54.537 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:54.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:54.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:54.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:55.503 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:55.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:55.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:55.601 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:55.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:55.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:55.653 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:55.664 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:55.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:55.711 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:55.711 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:55.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:55.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:55.747 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:55.769 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:55.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:55.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:55.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:55.804 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:55.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:55.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:55.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:56.770 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:56.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:56.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:56.868 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:56.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:56.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:56.920 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:56.930 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:56.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:56.978 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:56.979 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:57.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:57.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:57.002 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:57.036 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:57.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:57.036 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:57.037 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:57.061 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:57.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:57.062 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:57.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:58.038 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:58.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:58.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:58.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:58.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:58.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:58.188 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:58.198 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:58.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:58.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:58.247 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:58.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:58.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:58.285 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:58.303 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:58.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:58.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:58.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:58.341 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:58.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:58.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:58.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:59.305 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:59.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:59.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:59.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:59.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:59.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:59.452 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:03:59.462 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:03:59.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:03:59.509 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:59.509 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:03:59.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:03:59.544 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:59.544 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:03:59.566 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:59.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:59.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:59.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:59.602 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:59.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:59.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:59.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:00.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:00.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:00.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:00.663 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:00.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:00.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:00.715 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:00.726 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:00.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:00.775 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:00.775 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:00.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:00.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:00.797 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:00.833 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:00.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:00.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:00.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:00.854 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:00.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:00.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:00.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:01.835 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:01.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:01.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:01.933 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:01.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:01.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:01.985 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:01.995 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:02.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:02.042 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:02.042 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:02.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:02.067 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:02.067 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:02.098 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:02.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:02.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:02.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:02.124 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:02.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:02.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:02.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:03.099 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:03.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:03.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:03.197 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:03.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:03.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:03.249 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:03.260 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:03.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:03.309 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:03.309 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:03.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:03.350 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:03.351 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:03.366 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:03.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:03.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:03.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:03.407 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:03.407 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:03.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:03.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:04.368 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:04.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:04.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:04.467 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:04.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:04.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:04.519 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:04.529 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:04.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:04.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:04.578 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:04.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:04.614 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:04.614 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:04.635 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:04.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:04.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:04.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:04.672 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:04.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:04.672 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:04.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:05.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:05.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:05.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:05.734 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:05.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:05.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:05.787 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:05.797 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:05.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:05.845 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:05.846 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:05.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:05.872 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:05.872 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:05.903 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:05.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:05.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:05.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:05.929 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:05.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:05.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:05.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:06.904 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:06.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:06.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:07.002 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:07.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:07.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:07.054 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:07.064 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:07.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:07.113 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:07.113 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:07.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:07.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:07.140 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:07.169 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:07.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:07.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:07.170 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:07.196 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:07.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:07.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:07.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:08.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:08.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:08.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:08.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:08.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:08.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:08.311 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:08.321 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:08.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:08.368 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:08.368 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:08.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:08.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:08.399 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:08.425 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:08.426 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:08.426 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:08.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:08.456 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:08.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:08.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:08.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:09.427 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:09.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:09.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:09.524 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:09.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:09.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:09.575 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:09.585 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:09.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:09.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:09.633 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:09.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:09.659 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:09.659 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:09.691 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:09.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:09.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:09.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:09.716 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:09.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:09.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:09.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:10.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:10.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:10.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:10.791 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:10.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:10.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:10.843 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:10.853 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:10.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:10.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:10.902 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:10.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:10.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:10.930 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:10.959 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:10.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:10.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:10.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:10.986 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:10.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:10.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:10.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:11.960 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:11.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:11.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:12.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:12.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:12.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:12.110 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:12.121 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:12.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:12.169 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:12.170 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:12.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:12.198 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:12.198 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:12.226 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:12.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:12.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:12.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:12.255 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:12.255 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:12.255 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:12.255 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:13.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:13.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:13.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:13.325 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:13.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:13.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:13.378 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:13.388 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:13.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:13.437 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:13.437 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:13.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:13.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:13.471 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:13.494 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:13.494 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:13.494 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:13.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:13.527 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:13.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:13.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:13.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:14.495 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:14.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:14.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:14.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:14.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:14.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:14.647 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:14.657 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:14.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:14.706 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:14.706 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:14.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:14.740 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:14.740 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:14.763 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:14.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:14.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:14.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:14.797 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:14.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:14.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:14.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:15.764 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:15.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:15.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:15.863 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:15.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:15.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:15.915 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:15.926 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:15.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:15.975 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:15.975 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:16.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:16.016 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:16.016 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:16.033 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:16.034 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:16.034 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:16.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:16.073 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:16.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:16.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:16.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:17.034 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:17.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:17.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:17.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:17.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:17.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:17.185 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:17.195 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:17.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:17.243 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:17.243 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:17.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:17.280 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:17.280 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:17.301 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:17.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:17.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:17.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:17.337 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:17.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:17.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:17.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:18.303 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:18.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:18.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:18.402 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:18.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:18.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:18.454 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:18.465 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:18.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:18.514 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:18.514 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:18.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:18.539 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:18.539 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:18.570 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:18.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:18.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:18.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:18.596 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:18.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:18.597 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:18.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:19.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:19.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:19.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:19.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:19.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:19.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:19.723 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:19.734 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:19.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:19.741 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:19.742 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:19.798 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:19.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:19.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:19.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:19.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:19.822 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:19.822 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:19.880 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:19.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:19.880 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:19.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:20.799 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:20.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:20.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:20.870 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:20.881 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:20.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:20.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:20.946 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:20.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:20.952 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:20.952 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:21.008 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:21.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:21.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:21.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:21.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:21.032 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:21.032 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:21.091 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:21.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:21.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:21.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:22.009 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:22.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:22.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:22.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:22.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:22.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:22.160 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:22.172 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:22.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:22.219 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:22.219 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:22.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:22.236 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:22.236 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:22.276 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:22.276 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:22.276 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:22.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:22.294 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:22.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:22.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:22.294 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:23.277 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:23.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:23.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:23.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:23.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:23.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:23.428 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:23.439 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:23.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:23.486 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:23.486 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:23.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:23.517 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:23.518 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:23.542 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:23.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:23.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:23.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:23.575 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:23.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:23.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:23.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:24.544 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:24.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:24.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:24.642 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:24.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:24.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:24.694 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:24.705 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:24.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:24.753 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:24.753 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:24.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:24.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:24.779 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:24.811 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:24.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:24.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:24.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:24.836 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:24.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:24.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:24.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:25.813 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:25.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:25.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:25.910 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:25.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:25.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:25.962 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:25.973 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:26.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:26.023 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:26.023 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:26.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:26.048 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:26.049 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:26.080 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:26.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:26.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:26.081 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:26.106 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:26.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:26.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:26.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:27.082 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:27.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:27.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:27.147 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:27.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:27.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:27.199 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:27.209 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:27.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:27.257 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:27.257 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:27.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:27.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:27.291 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:27.314 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:27.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:27.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:27.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:27.348 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:27.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:27.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:27.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:28.315 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:28.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:28.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:28.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:28.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:28.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:28.416 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:28.426 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:28.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:28.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:28.474 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:28.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:28.504 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:28.504 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:28.532 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:28.532 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:28.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:28.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:28.561 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:28.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:28.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:28.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:29.533 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:29.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:29.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:29.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:29.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:29.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:29.684 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:29.694 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:29.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:29.742 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:29.743 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:29.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:29.768 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:29.768 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:29.800 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:29.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:29.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:29.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:29.826 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:29.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:29.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:29.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:30.801 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:30.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:30.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:30.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:30.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:30.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:30.952 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:30.962 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:31.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:31.010 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:31.010 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:31.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:31.037 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:31.038 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:31.067 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:31.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:31.067 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:31.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:31.095 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:31.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:31.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:31.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:32.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:32.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:32.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:32.168 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:32.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:32.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:32.220 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:32.230 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:32.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:32.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:32.278 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:32.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:32.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:32.317 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:32.336 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:32.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:32.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:32.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:32.375 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:32.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:32.376 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:32.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:33.337 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:33.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:33.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:33.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:33.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:33.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:33.493 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:33.503 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:33.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:33.551 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:33.551 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:33.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:33.584 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:33.584 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:33.608 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:33.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:33.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:33.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:33.640 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:33.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:33.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:33.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:34.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:34.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:34.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:34.707 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:34.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:34.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:34.759 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:34.770 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:34.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:34.777 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:34.777 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:34.834 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:34.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:34.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:34.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:34.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:34.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:34.847 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:34.904 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:34.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:34.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:34.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:35.835 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:35.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:35.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:35.934 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:35.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:35.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:35.986 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:35.996 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:36.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:36.045 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:36.045 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:36.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:36.070 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:36.070 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:36.102 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:36.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:36.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:36.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:36.128 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:36.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:36.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:36.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:37.104 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:37.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:37.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:37.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:37.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:37.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:37.255 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:37.265 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:37.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:37.314 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:37.314 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:37.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:37.338 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:37.338 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:37.372 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:37.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:37.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:37.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:37.394 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:37.394 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:37.394 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:37.394 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:38.372 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:38.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:38.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:38.471 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:38.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:38.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:38.523 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:38.533 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:38.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:38.581 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:38.582 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:38.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:38.613 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:38.613 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:38.638 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:38.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:38.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:38.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:38.670 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:38.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:38.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:38.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:39.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:39.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:39.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:39.739 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:39.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:39.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:39.819 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:39.830 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:39.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:39.838 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:39.839 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:39.895 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:39.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:39.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:39.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:39.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:39.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:39.904 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:39.962 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:39.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:39.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:39.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:40.896 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:40.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:40.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:41.004 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:41.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:41.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:41.056 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:41.066 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:41.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:41.114 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:41.114 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:41.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:41.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:41.150 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:41.171 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:41.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:41.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:41.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:41.207 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:41.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:41.208 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:41.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:42.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:42.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:42.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:42.271 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:42.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:42.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:42.323 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:42.334 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:42.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:42.380 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:42.380 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:42.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:42.414 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:42.415 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:42.437 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:42.437 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:42.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:42.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:42.471 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:42.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:42.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:42.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:43.438 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:43.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:43.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:43.537 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:43.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:43.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:43.589 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:43.599 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:43.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:43.607 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:43.607 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:43.664 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:43.664 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:43.664 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:43.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:43.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:43.675 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:43.675 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:43.732 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:43.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:43.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:43.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:44.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:44.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:44.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:44.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:44.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:44.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:44.817 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:44.827 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:44.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:44.876 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:44.876 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:44.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:44.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:44.905 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:44.933 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:44.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:44.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:44.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:44.962 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:44.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:44.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:44.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:45.934 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:45.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:45.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:46.021 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:46.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:46.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:46.073 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:46.084 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:46.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:46.132 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:46.132 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:46.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:46.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:46.165 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:46.189 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:46.189 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:46.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:46.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:46.222 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:46.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:46.223 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:46.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:47.191 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:47.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:47.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:47.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:47.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:47.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:47.341 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:47.351 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:47.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:47.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:47.400 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:47.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:47.429 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:47.429 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:47.456 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:47.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:47.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:47.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:47.486 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:47.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:47.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:47.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:48.457 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:48.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:48.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:48.555 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:48.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:48.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:48.608 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:48.619 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:48.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:48.665 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:48.665 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:48.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:48.703 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:48.703 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:48.721 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:48.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:48.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:48.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:48.760 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:48.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:48.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:48.761 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:49.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:49.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:49.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:49.820 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:49.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:49.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:49.872 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:49.882 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:49.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:49.930 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:49.930 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:49.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:49.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:49.962 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:49.987 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:49.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:49.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:49.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:50.020 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:50.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:50.020 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:50.020 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:50.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:50.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:50.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:51.087 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:51.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:51.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:51.139 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:51.149 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:51.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:51.197 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:51.198 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:51.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:51.224 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:51.224 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:51.254 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:51.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:51.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:51.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:51.281 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:51.281 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:51.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:51.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:52.256 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:52.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:52.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:52.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:52.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:52.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:52.404 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:52.414 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:52.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:52.463 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:52.463 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:52.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:52.491 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:52.491 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:52.519 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:52.519 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:52.519 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:52.519 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:52.549 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:52.549 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:52.549 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:52.549 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:53.520 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:53.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:53.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:53.618 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:53.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:53.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:53.670 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:53.681 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:53.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:53.729 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:53.729 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:53.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:53.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:53.767 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:53.786 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:53.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:53.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:53.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:53.824 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:53.824 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:53.824 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:53.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:54.788 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:54.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:54.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:54.887 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:54.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:54.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:54.938 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:54.949 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:54.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:54.996 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:54.996 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:55.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:55.034 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:55.034 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:55.052 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:55.052 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:55.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:55.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:55.092 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:55.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:55.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:55.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:56.054 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:56.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:56.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:56.152 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:56.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:56.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:56.203 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:56.214 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:56.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:56.262 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:56.262 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:56.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:56.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:56.291 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:56.320 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:56.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:56.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:56.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:56.348 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:56.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:56.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:56.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:57.321 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:57.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:57.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:57.419 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:57.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:57.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:57.471 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:57.481 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:57.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:57.531 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:57.531 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:57.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:57.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:57.563 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:57.587 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:57.587 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:57.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:57.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:57.619 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:57.620 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:57.620 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:57.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:58.589 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:58.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:58.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:58.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:58.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:58.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:58.739 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:04:58.750 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:04:58.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:58.799 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:58.799 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:04:58.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:58.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:58.826 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:04:58.855 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:58.856 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:58.856 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:58.856 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:58.883 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:58.884 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:58.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:58.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:59.857 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:59.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:04:59.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:59.956 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:59.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:04:59.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:00.008 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:00.018 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:00.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:00.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:00.066 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:00.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:00.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:00.091 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:00.125 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:00.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:00.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:00.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:00.149 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:00.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:00.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:00.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:01.126 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:01.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:01.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:01.225 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:01.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:01.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:01.281 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:01.292 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:01.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:01.340 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:01.340 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:01.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:01.381 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:01.381 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:01.398 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:01.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:01.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:01.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:01.440 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:01.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:01.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:01.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:02.400 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:02.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:02.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:02.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:02.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:02.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:02.552 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:02.562 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:02.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:02.570 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:02.570 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:02.627 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:02.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:02.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:02.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:02.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:02.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:02.645 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:02.702 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:02.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:02.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:02.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:03.628 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:03.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:03.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:03.727 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:03.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:03.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:03.779 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:03.790 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:03.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:03.797 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:03.797 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:03.854 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:03.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:03.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:03.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:03.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:03.865 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:03.865 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:03.923 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:03.923 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:03.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:03.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:04.856 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:04.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:04.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:04.954 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:04.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:04.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:05.007 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:05.017 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:05.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:05.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:05.066 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:05.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:05.094 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:05.094 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:05.122 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:05.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:05.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:05.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:05.152 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:05.153 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:05.153 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:05.153 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:06.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:06.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:06.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:06.222 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:06.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:06.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:06.275 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:06.285 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:06.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:06.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:06.334 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:06.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:06.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:06.370 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:06.390 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:06.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:06.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:06.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:06.428 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:06.428 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:06.428 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:06.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:07.392 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:07.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:07.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:07.491 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:07.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:07.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:07.543 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:07.553 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:07.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:07.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:07.602 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:07.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:07.635 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:07.635 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:07.659 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:07.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:07.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:07.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:07.692 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:07.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:07.692 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:07.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:08.660 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:08.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:08.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:08.760 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:08.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:08.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:08.813 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:08.823 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:08.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:08.873 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:08.873 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:08.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:08.904 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:08.905 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:08.930 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:08.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:08.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:08.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:08.961 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:08.961 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:08.961 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:08.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:09.931 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:09.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:09.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:10.029 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:10.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:10.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:10.082 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:10.093 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:10.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:10.141 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:10.141 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:10.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:10.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:10.169 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:10.197 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:10.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:10.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:10.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:10.227 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:10.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:10.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:10.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:11.198 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:11.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:11.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:11.297 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:11.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:11.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:11.349 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:11.359 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:11.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:11.407 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:11.407 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:11.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:11.448 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:11.449 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:11.465 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:11.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:11.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:11.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:11.505 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:11.506 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:11.506 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:11.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:12.467 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:12.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:12.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:12.566 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:12.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:12.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:12.618 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:12.628 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:12.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:12.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:12.677 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:12.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:12.711 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:12.711 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:12.735 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:12.735 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:12.735 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:12.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:12.768 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:12.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:12.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:12.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:13.736 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:13.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:13.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:13.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:13.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:13.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:13.886 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:13.896 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:13.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:13.945 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:13.945 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:13.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:13.978 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:13.978 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:14.001 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:14.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:14.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:14.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:14.036 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:14.036 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:14.037 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:14.037 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:15.003 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:15.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:15.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:15.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:15.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:15.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:15.154 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:15.164 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:15.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:15.213 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:15.213 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:15.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:15.242 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:15.242 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:15.270 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:15.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:15.271 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:15.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:15.300 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:15.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:15.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:15.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:16.272 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:16.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:16.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:16.370 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:16.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:16.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:16.423 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:16.433 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:16.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:16.482 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:16.482 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:16.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:16.522 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:16.522 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:16.539 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:16.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:16.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:16.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:16.580 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:16.580 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:16.580 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:16.580 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:17.540 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:17.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:17.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:17.637 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:17.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:17.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:17.689 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:17.700 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:17.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:17.747 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:17.747 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:17.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:17.771 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:17.771 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:17.805 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:17.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:17.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:17.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:17.828 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:17.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:17.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:17.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:18.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:18.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:18.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:18.904 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:18.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:18.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:18.957 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:18.967 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:19.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:19.017 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:19.017 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:19.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:19.049 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:19.049 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:19.075 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:19.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:19.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:19.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:19.105 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:19.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:19.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:19.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:20.076 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:20.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:20.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:20.175 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:20.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:20.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:20.227 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:20.237 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:20.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:20.285 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:20.285 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:20.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:20.326 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:20.326 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:20.342 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:20.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:20.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:20.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:20.383 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:20.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:20.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:20.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:21.344 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:21.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:21.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:21.406 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:21.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:21.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:21.458 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:21.468 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:21.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:21.514 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:21.514 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:21.545 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:21.545 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:21.546 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:21.571 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:21.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:21.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:21.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:21.602 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:21.602 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:21.602 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:21.602 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:22.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:22.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:22.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:22.672 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:22.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:22.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:22.724 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:22.734 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:22.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:22.783 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:22.784 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:22.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:22.814 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:22.814 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:22.840 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:22.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:22.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:22.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:22.871 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:22.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:22.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:22.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:23.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:23.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:23.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:23.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:23.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:23.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:23.992 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:24.002 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:24.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:24.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:24.052 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:24.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:24.076 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:24.076 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:24.108 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:24.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:24.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:24.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:24.133 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:24.133 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:24.133 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:24.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:25.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:25.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:25.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:25.208 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:25.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:25.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:25.260 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:25.270 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:25.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:25.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:25.317 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:25.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:25.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:25.346 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:25.375 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:25.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:25.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:25.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:25.404 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:25.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:25.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:25.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:26.376 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:26.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:26.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:26.474 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:26.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:26.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:26.527 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:26.537 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:26.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:26.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:26.586 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:26.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:26.620 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:26.620 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:26.643 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:26.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:26.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:26.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:26.677 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:26.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:26.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:26.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:27.645 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:27.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:27.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:27.743 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:27.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:27.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:27.796 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:27.806 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:27.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:27.855 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:27.855 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:27.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:27.894 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:27.894 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:27.913 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:27.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:27.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:27.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:27.951 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:27.952 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:27.952 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:27.952 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:28.914 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:28.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:28.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:29.013 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:29.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:29.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:29.065 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:29.075 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:29.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:29.122 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:29.122 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:29.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:29.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:29.162 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:29.179 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:29.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:29.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:29.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:29.219 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:29.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:29.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:29.220 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:30.180 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:30.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:30.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:30.280 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:30.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:30.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:30.332 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:30.343 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:30.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:30.392 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:30.392 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:30.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:30.420 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:30.420 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:30.447 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:30.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:30.448 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:30.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:30.476 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:30.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:30.476 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:30.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:31.449 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:31.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:31.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:31.548 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:31.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:31.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:31.599 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:31.610 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:31.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:31.658 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:31.658 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:31.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:31.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:31.688 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:31.716 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:31.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:31.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:31.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:31.747 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:31.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:31.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:31.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:32.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:32.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:32.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:32.816 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:32.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:32.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:32.868 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:32.879 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:32.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:32.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:32.928 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:32.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:32.963 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:32.963 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:32.985 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:32.985 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:32.985 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:32.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:33.020 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:33.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:33.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:33.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:33.986 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:33.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:33.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:34.084 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:34.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:34.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:34.137 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:34.147 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:34.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:34.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:34.195 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:34.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:34.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:34.229 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:34.252 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:34.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:34.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:34.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:34.286 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:34.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:34.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:34.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:35.253 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:35.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:35.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:35.352 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:35.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:35.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:35.404 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:35.414 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:35.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:35.463 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:35.463 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:35.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:35.495 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:35.495 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:35.519 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:35.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:35.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:35.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:35.552 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:35.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:35.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:35.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:36.520 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:36.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:36.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:36.619 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:36.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:36.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:36.672 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:36.682 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:36.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:36.729 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:36.729 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:36.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:36.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:36.755 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:36.786 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:36.786 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:36.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:36.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:36.811 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:36.811 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:36.811 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:36.811 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:37.787 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:37.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:37.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:37.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:37.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:37.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:37.920 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:37.931 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:37.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:37.940 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:37.940 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:37.998 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:37.998 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:37.998 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:37.998 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:38.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:38.015 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:38.015 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:38.071 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:38.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:38.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:38.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:38.999 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:38.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:39.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:39.098 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:39.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:39.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:39.150 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:39.160 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:39.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:39.208 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:39.208 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:39.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:39.239 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:39.240 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:39.265 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:39.265 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:39.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:39.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:39.296 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:39.296 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:39.296 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:39.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:40.266 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:40.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:40.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:40.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:40.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:40.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:40.418 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:40.428 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:40.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:40.476 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:40.476 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:40.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:40.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:40.503 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:40.533 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:40.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:40.533 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:40.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:40.560 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:40.560 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:40.560 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:40.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:41.535 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:41.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:41.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:41.633 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:41.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:41.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:41.685 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:41.696 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:41.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:41.743 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:41.744 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:41.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:41.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:41.770 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:41.801 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:41.801 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:41.801 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:41.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:41.826 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:41.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:41.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:41.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:42.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:42.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:42.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:42.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:42.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:42.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:42.951 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:42.962 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:43.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:43.011 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:43.011 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:43.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:43.036 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:43.037 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:43.068 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:43.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:43.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:43.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:43.093 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:43.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:43.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:43.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:44.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:44.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:44.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:44.167 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:44.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:44.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:44.218 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:44.229 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:44.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:44.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:44.278 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:44.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:44.315 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:44.315 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:44.336 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:44.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:44.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:44.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:44.372 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:44.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:44.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:44.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:45.338 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:45.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:45.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:45.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:45.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:45.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:45.488 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:45.498 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:45.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:45.546 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:45.547 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:45.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:45.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:45.582 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:45.603 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:45.603 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:45.603 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:45.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:45.639 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:45.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:45.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:45.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:46.604 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:46.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:46.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:46.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:46.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:46.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:46.753 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:46.763 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:46.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:46.811 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:46.811 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:46.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:46.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:46.847 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:46.868 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:46.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:46.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:46.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:46.904 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:46.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:46.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:46.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:47.870 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:47.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:47.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:47.968 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:47.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:47.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:48.021 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:48.031 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:48.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:48.079 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:48.079 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:48.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:48.117 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:48.117 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:48.136 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:48.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:48.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:48.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:48.173 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:48.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:48.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:48.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:49.138 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:49.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:49.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:49.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:49.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:49.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:49.289 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:49.299 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:49.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:49.348 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:49.348 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:49.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:49.374 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:49.374 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:49.404 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:49.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:49.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:49.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:49.432 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:49.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:49.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:49.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:50.405 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:50.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:50.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:50.502 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:50.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:50.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:50.554 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:50.564 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:50.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:50.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:50.613 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:50.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:50.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:50.646 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:50.670 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:50.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:50.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:50.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:50.702 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:50.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:50.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:50.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:51.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:51.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:51.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:51.769 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:51.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:51.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:51.821 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:51.831 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:51.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:51.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:51.880 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:51.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:51.909 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:51.909 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:51.937 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:51.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:51.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:51.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:51.967 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:51.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:51.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:51.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:52.938 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:52.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:52.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:53.037 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:53.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:53.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:53.088 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:53.099 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:53.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:53.146 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:53.146 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:53.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:53.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:53.172 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:53.204 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:53.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:53.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:53.205 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:53.229 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:53.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:53.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:53.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:54.205 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:54.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:54.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:54.304 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:54.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:54.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:54.356 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:54.367 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:54.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:54.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:54.374 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:54.431 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:54.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:54.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:54.431 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:54.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:54.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:54.446 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:54.504 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:54.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:54.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:54.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:55.432 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:55.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:55.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:55.531 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:55.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:55.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:55.583 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:55.593 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:55.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:55.642 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:55.642 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:55.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:55.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:55.669 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:55.699 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:55.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:55.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:55.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:55.726 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:55.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:55.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:55.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:56.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:56.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:56.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:56.799 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:56.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:56.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:56.851 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:56.861 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:56.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:56.910 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:56.910 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:56.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:56.945 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:56.945 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:56.966 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:56.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:56.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:56.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:57.004 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:57.004 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:57.004 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:57.004 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:57.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:57.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:57.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:58.066 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:58.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:58.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:58.119 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:58.130 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:58.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:58.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:58.137 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:58.196 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:58.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:58.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:58.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:58.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:58.209 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:58.209 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:58.266 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:58.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:58.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:58.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:59.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:59.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:59.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:59.297 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:59.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:59.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:59.348 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:05:59.358 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:05:59.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:05:59.406 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:59.406 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:05:59.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:05:59.437 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:59.437 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:05:59.463 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:59.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:59.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:59.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:59.494 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:59.495 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:59.495 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:59.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:00.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:00.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:00.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:00.563 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:00.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:00.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:00.615 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:00.625 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:00.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:00.674 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:00.674 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:00.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:00.701 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:00.701 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:00.732 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:00.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:00.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:00.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:00.758 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:00.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:00.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:00.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:01.733 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:01.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:01.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:01.833 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:01.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:01.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:01.885 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:01.895 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:01.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:01.944 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:01.944 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:01.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:01.974 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:01.974 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:02.001 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:02.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:02.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:02.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:02.030 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:02.031 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:02.031 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:02.031 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:03.003 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:03.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:03.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:03.100 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:03.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:03.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:03.153 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:03.163 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:03.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:03.212 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:03.212 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:03.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:03.251 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:03.252 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:03.268 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:03.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:03.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:03.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:03.309 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:03.309 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:03.309 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:03.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:04.269 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:04.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:04.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:04.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:04.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:04.419 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:04.430 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:04.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:04.480 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:04.480 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:04.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:04.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:04.521 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:04.537 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:04.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:04.537 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:04.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:04.577 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:04.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:04.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:04.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:05.538 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:05.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:05.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:05.637 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:05.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:05.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:05.689 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:05.699 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:05.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:05.748 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:05.749 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:05.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:05.775 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:05.775 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:05.805 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:05.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:05.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:05.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:05.832 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:05.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:05.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:05.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:06.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:06.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:06.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:06.906 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:06.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:06.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:06.957 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:06.968 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:07.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:07.016 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:07.016 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:07.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:07.046 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:07.046 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:07.074 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:07.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:07.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:07.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:07.102 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:07.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:07.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:07.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:08.075 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:08.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:08.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:08.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:08.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:08.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:08.189 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:08.199 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:08.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:08.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:08.248 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:08.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:08.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:08.273 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:08.304 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:08.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:08.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:08.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:08.331 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:08.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:08.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:08.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:09.305 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:09.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:09.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:09.404 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:09.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:09.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:09.456 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:09.467 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:09.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:09.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:09.516 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:09.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:09.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:09.548 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:09.573 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:09.573 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:09.573 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:09.573 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:09.604 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:09.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:09.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:09.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:10.574 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:10.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:10.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:10.674 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:10.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:10.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:10.726 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:10.736 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:10.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:10.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:10.785 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:10.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:10.820 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:10.820 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:10.841 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:10.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:10.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:10.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:10.878 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:10.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:10.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:10.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:11.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:11.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:11.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:11.941 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:11.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:11.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:11.993 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:12.003 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:12.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:12.051 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:12.051 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:12.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:12.082 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:12.082 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:12.108 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:12.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:12.108 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:12.108 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:12.140 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:12.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:12.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:12.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:13.109 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:13.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:13.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:13.210 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:13.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:13.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:13.265 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:13.276 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:13.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:13.284 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:13.284 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:13.340 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:13.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:13.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:13.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:13.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:13.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:13.355 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:13.413 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:13.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:13.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:13.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:14.341 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:14.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:14.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:14.440 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:14.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:14.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:14.492 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:14.502 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:14.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:14.551 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:14.551 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:14.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:14.589 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:14.589 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:14.609 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:14.609 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:14.609 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:14.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:14.647 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:14.647 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:14.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:14.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:15.610 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:15.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:15.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:15.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:15.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:15.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:15.740 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:15.750 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:15.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:15.796 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:15.796 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:15.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:15.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:15.826 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:15.853 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:15.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:15.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:15.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:15.883 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:15.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:15.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:15.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:16.854 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:16.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:16.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:16.942 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:16.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:16.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:16.995 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:17.005 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:17.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:17.053 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:17.053 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:17.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:17.096 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:17.097 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:17.110 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:17.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:17.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:17.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:17.153 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:17.153 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:17.153 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:17.153 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:18.111 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:18.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:18.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:18.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:18.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:18.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:18.264 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:18.275 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:18.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:18.283 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:18.283 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:18.341 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:18.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:18.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:18.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:18.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:18.357 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:18.357 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:18.413 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:18.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:18.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:18.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:19.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:19.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:19.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:19.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:19.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:19.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:19.519 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:19.529 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:19.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:19.537 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:19.537 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:19.594 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:19.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:19.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:19.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:19.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:19.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:19.608 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:19.665 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:19.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:19.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:19.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:20.595 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:20.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:20.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:20.710 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:20.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:20.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:20.771 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:20.781 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:20.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:20.788 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:20.789 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:20.846 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:20.846 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:20.846 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:20.846 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:20.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:20.856 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:20.856 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:20.914 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:20.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:20.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:20.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:21.847 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:21.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:21.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:21.972 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:21.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:21.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:22.026 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:22.036 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:22.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:22.043 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:22.043 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:22.101 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:22.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:22.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:22.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:22.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:22.125 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:22.125 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:22.182 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:22.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:22.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:22.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:23.102 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:23.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:23.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:23.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:23.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:23.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:23.285 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:23.296 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:23.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:23.303 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:23.303 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:23.360 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:23.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:23.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:23.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:23.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:23.374 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:23.374 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:23.431 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:23.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:23.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:23.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:24.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:24.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:24.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:24.484 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:24.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:24.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:24.538 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:24.548 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:24.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:24.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:24.556 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:24.613 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:24.613 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:24.613 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:24.613 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:24.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:24.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:24.628 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:24.686 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:24.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:24.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:24.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:25.614 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:25.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:25.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:25.712 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:25.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:25.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:25.764 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:25.775 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:25.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:25.823 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:25.824 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:25.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:25.857 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:25.857 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:25.880 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:25.880 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:25.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:25.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:25.914 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:25.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:25.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:25.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:26.882 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:26.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:26.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:26.981 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:26.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:26.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:27.033 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:27.043 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:27.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:27.092 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:27.092 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:27.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:27.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:27.127 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:27.148 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:27.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:27.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:27.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:27.184 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:27.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:27.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:27.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:28.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:28.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:28.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:28.245 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:28.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:28.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:28.297 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:28.307 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:28.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:28.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:28.354 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:28.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:28.386 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:28.386 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:28.413 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:28.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:28.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:28.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:28.443 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:28.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:28.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:28.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:29.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:29.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:29.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:29.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:29.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:29.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:29.555 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:29.565 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:29.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:29.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:29.614 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:29.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:29.654 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:29.654 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:29.670 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:29.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:29.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:29.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:29.712 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:29.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:29.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:29.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:30.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:30.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:30.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:30.770 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:30.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:30.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:30.821 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:30.832 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:30.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:30.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:30.880 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:30.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:30.916 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:30.916 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:30.939 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:30.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:30.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:30.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:30.973 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:30.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:30.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:30.974 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:31.940 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:31.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:31.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:32.038 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:32.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:32.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:32.090 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:32.100 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:32.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:32.148 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:32.148 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:32.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:32.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:32.186 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:32.206 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:32.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:32.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:32.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:32.242 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:32.243 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:32.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:32.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:33.207 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:33.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:33.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:33.305 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:33.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:33.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:33.358 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:33.369 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:33.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:33.417 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:33.417 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:33.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:33.444 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:33.444 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:33.474 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:33.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:33.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:33.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:33.501 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:33.501 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:33.501 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:33.501 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:34.475 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:34.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:34.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:34.573 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:34.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:34.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:34.624 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:34.634 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:34.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:34.684 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:34.684 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:34.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:34.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:34.714 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:34.741 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:34.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:34.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:34.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:34.770 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:34.771 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:34.771 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:34.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:35.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:35.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:35.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:35.841 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:35.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:35.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:35.893 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:35.903 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:35.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:35.952 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:35.952 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:35.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:35.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:35.989 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:36.009 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:36.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:36.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:36.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:36.045 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:36.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:36.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:36.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:37.010 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:37.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:37.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:37.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:37.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:37.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:37.160 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:37.170 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:37.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:37.220 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:37.220 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:37.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:37.254 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:37.254 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:37.277 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:37.277 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:37.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:37.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:37.312 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:37.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:37.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:37.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:38.279 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:38.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:38.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:38.377 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:38.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:38.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:38.429 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:38.440 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:38.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:38.488 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:38.489 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:38.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:38.517 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:38.517 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:38.545 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:38.546 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:38.546 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:38.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:38.575 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:38.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:38.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:38.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:39.547 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:39.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:39.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:39.646 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:39.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:39.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:39.699 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:39.709 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:39.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:39.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:39.758 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:39.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:39.798 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:39.798 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:39.815 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:39.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:39.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:39.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:39.854 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:39.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:39.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:39.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:40.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:40.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:40.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:40.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:40.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:40.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:40.966 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:40.977 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:41.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:41.025 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:41.025 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:41.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:41.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:41.054 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:41.082 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:41.082 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:41.082 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:41.082 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:41.110 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:41.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:41.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:41.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:42.083 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:42.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:42.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:42.181 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:42.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:42.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:42.233 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:42.243 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:42.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:42.292 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:42.292 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:42.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:42.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:42.316 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:42.348 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:42.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:42.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:42.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:42.372 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:42.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:42.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:42.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:43.350 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:43.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:43.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:43.448 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:43.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:43.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:43.500 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:43.510 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:43.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:43.559 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:43.559 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:43.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:43.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:43.601 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:43.615 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:43.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:43.615 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:43.615 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:43.658 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:43.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:43.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:43.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:44.616 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:44.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:44.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:44.714 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:44.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:44.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:44.766 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:44.777 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:44.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:44.824 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:44.824 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:44.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:44.857 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:44.857 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:44.880 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:44.881 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:44.881 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:44.881 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:44.913 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:44.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:44.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:44.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:45.882 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:45.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:45.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:45.981 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:45.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:45.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:46.033 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:46.043 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:46.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:46.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:46.091 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:46.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:46.122 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:46.122 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:46.148 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:46.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:46.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:46.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:46.179 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:46.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:46.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:46.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:47.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:47.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:47.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:47.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:47.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:47.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:47.299 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:47.310 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:47.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:47.357 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:47.357 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:47.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:47.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:47.400 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:47.416 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:47.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:47.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:47.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:47.458 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:47.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:47.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:47.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:48.417 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:48.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:48.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:48.517 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:48.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:48.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:48.569 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:48.580 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:48.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:48.629 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:48.629 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:48.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:48.659 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:48.659 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:48.685 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:48.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:48.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:48.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:48.717 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:48.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:48.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:48.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:49.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:49.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:49.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:49.785 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:49.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:49.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:49.837 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:49.847 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:49.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:49.895 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:49.895 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:49.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:49.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:49.924 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:49.951 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:49.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:49.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:49.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:49.981 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:49.981 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:49.981 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:49.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:50.953 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:50.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:50.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:51.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:51.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:51.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:51.122 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:51.133 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:51.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:51.140 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:51.140 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:51.198 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:51.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:51.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:51.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:51.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:51.214 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:51.214 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:51.272 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:51.272 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:51.272 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:51.272 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:52.200 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:52.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:52.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:52.298 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:52.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:52.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:52.350 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:52.361 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:52.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:52.410 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:52.410 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:52.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:52.434 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:52.435 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:52.467 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:52.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:52.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:52.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:52.492 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:52.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:52.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:52.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:53.468 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:53.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:53.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:53.566 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:53.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:53.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:53.619 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:53.629 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:53.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:53.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:53.677 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:53.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:53.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:53.717 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:53.734 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:53.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:53.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:53.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:53.773 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:53.773 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:53.774 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:53.774 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:54.735 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:54.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:54.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:54.833 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:54.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:54.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:54.885 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:54.895 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:54.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:54.944 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:54.944 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:54.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:54.975 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:54.975 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:55.000 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:55.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:55.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:55.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:55.032 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:55.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:55.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:55.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:56.001 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:56.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:56.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:56.100 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:56.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:56.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:56.151 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:56.162 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:56.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:56.211 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:56.211 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:56.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:56.250 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:56.250 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:56.267 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:56.267 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:56.267 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:56.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:56.307 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:56.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:56.308 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:56.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:57.268 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:57.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:57.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:57.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:57.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:57.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:57.419 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:57.429 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:57.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:57.478 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:57.478 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:57.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:57.512 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:57.512 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:57.534 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:57.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:57.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:57.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:57.568 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:57.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:57.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:57.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:58.535 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:58.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:58.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:58.634 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:58.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:58.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:58.686 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:58.697 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:06:58.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:58.744 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:58.744 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:06:58.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:58.780 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:58.780 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:06:58.801 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:58.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:58.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:58.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:58.838 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:58.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:58.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:58.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:59.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:59.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:06:59.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:59.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:59.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:06:59.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:59.952 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:06:59.962 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:00.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:00.011 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:00.011 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:00.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:00.041 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:00.041 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:00.068 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:00.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:00.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:00.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:00.099 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:00.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:00.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:00.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:01.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:01.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:01.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:01.170 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:01.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:01.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:01.222 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:01.232 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:01.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:01.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:01.281 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:01.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:01.310 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:01.311 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:01.337 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:01.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:01.337 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:01.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:01.367 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:01.368 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:01.368 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:01.368 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:02.338 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:02.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:02.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:02.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:02.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:02.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:02.490 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:02.500 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:02.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:02.549 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:02.549 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:02.575 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:02.576 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:02.576 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:02.606 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:02.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:02.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:02.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:02.632 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:02.632 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:02.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:02.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:03.608 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:03.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:03.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:03.704 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:03.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:03.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:03.757 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:03.767 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:03.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:03.816 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:03.816 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:03.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:03.853 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:03.853 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:03.873 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:03.873 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:03.873 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:03.873 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:03.910 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:03.910 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:03.910 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:03.910 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:04.874 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:04.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:04.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:04.973 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:04.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:04.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:05.025 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:05.035 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:05.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:05.084 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:05.084 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:05.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:05.114 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:05.114 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:05.140 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:05.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:05.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:05.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:05.171 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:05.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:05.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:05.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:06.141 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:06.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:06.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:06.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:06.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:06.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:06.292 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:06.303 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:06.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:06.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:06.352 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:06.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:06.374 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:06.374 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:06.408 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:06.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:06.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:06.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:06.431 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:06.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:06.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:06.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:07.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:07.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:07.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:07.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:07.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:07.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:07.561 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:07.572 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:07.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:07.619 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:07.619 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:07.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:07.656 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:07.656 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:07.677 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:07.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:07.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:07.678 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:07.712 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:07.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:07.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:07.713 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:08.678 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:08.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:08.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:08.778 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:08.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:08.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:08.830 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:08.840 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:08.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:08.888 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:08.888 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:08.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:08.914 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:08.914 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:08.946 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:08.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:08.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:08.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:08.972 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:08.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:08.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:08.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:09.948 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:09.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:09.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:10.047 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:10.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:10.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:10.098 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:10.109 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:10.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:10.157 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:10.157 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:10.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:10.192 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:10.192 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:10.214 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:10.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:10.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:10.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:10.250 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:10.250 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:10.250 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:10.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:11.216 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:11.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:11.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:11.315 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:11.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:11.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:11.368 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:11.379 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:11.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:11.386 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:11.386 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:11.442 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:11.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:11.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:11.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:11.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:11.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:11.462 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:11.518 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:11.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:11.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:11.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:12.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:12.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:12.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:12.542 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:12.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:12.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:12.594 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:12.605 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:12.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:12.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:12.654 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:12.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:12.684 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:12.685 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:12.711 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:12.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:12.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:12.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:12.741 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:12.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:12.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:12.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:13.712 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:13.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:13.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:13.811 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:13.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:13.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:13.863 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:13.874 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:13.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:13.921 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:13.921 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:13.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:13.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:13.960 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:13.978 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:13.978 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:13.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:13.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:14.018 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:14.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:14.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:14.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:14.979 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:14.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:14.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:15.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:15.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:15.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:15.129 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:15.139 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:15.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:15.187 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:15.187 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:15.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:15.220 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:15.221 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:15.244 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:15.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:15.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:15.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:15.277 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:15.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:15.278 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:15.278 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:16.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:16.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:16.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:16.345 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:16.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:16.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:16.397 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:16.407 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:16.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:16.455 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:16.455 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:16.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:16.479 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:16.480 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:16.513 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:16.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:16.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:16.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:16.537 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:16.537 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:16.538 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:16.538 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:17.514 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:17.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:17.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:17.612 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:17.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:17.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:17.665 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:17.675 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:17.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:17.724 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:17.724 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:17.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:17.745 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:17.745 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:17.782 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:17.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:17.782 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:17.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:17.802 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:17.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:17.803 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:17.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:18.784 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:18.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:18.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:18.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:18.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:18.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:18.901 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:18.912 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:18.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:18.959 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:18.959 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:18.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:18.993 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:18.993 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:19.015 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:19.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:19.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:19.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:19.050 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:19.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:19.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:19.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:20.017 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:20.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:20.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:20.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:20.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:20.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:20.167 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:20.177 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:20.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:20.226 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:20.226 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:20.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:20.255 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:20.255 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:20.282 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:20.282 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:20.282 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:20.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:20.312 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:20.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:20.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:20.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:21.284 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:21.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:21.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:21.382 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:21.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:21.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:21.434 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:21.444 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:21.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:21.493 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:21.493 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:21.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:21.519 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:21.519 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:21.550 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:21.550 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:21.550 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:21.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:21.576 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:21.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:21.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:21.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:22.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:22.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:22.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:22.633 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:22.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:22.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:22.684 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:22.694 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:22.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:22.743 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:22.743 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:22.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:22.774 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:22.774 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:22.800 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:22.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:22.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:22.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:22.831 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:22.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:22.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:22.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:23.801 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:23.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:23.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:23.857 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:23.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:23.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:23.909 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:23.919 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:23.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:23.968 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:23.968 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:24.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:24.008 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:24.008 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:24.025 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:24.025 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:24.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:24.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:24.065 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:24.065 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:24.065 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:24.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:25.026 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:25.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:25.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:25.087 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:25.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:25.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:25.139 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:25.150 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:25.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:25.198 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:25.198 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:25.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:25.234 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:25.234 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:25.255 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:25.255 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:25.255 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:25.255 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:25.292 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:25.292 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:25.292 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:25.292 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:26.256 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:26.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:26.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:26.325 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:26.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:26.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:26.377 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:26.387 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:26.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:26.435 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:26.435 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:26.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:26.460 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:26.460 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:26.492 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:26.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:26.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:26.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:26.518 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:26.518 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:26.518 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:26.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:27.494 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:27.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:27.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:27.563 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:27.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:27.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:27.615 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:27.626 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:27.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:27.674 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:27.674 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:27.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:27.705 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:27.705 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:27.730 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:27.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:27.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:27.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:27.761 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:27.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:27.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:27.761 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:28.731 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:28.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:28.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:28.811 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:28.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:28.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:28.938 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:28.948 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:28.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:28.997 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:28.998 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:29.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:29.036 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:29.036 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:29.054 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:29.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:29.054 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:29.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:29.094 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:29.094 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:29.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:29.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:30.055 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:30.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:30.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:30.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:30.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:30.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:30.205 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:30.215 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:30.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:30.263 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:30.263 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:30.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:30.305 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:30.305 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:30.320 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:30.321 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:30.321 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:30.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:30.362 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:30.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:30.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:30.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:31.322 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:31.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:31.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:31.421 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:31.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:31.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:31.473 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:31.483 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:31.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:31.531 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:31.531 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:31.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:31.572 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:31.572 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:31.588 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:31.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:31.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:31.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:31.629 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:31.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:31.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:31.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:32.590 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:32.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:32.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:32.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:32.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:32.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:32.741 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:32.751 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:32.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:32.798 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:32.798 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:32.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:32.828 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:32.828 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:32.854 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:32.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:32.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:32.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:32.886 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:32.886 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:32.886 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:32.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:33.856 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:33.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:33.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:33.954 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:33.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:33.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:34.007 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:34.017 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:34.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:34.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:34.066 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:34.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:34.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:34.099 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:34.122 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:34.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:34.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:34.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:34.157 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:34.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:34.158 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:34.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:35.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:35.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:35.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:35.222 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:35.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:35.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:35.274 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:35.284 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:35.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:35.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:35.334 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:35.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:35.375 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:35.375 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:35.392 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:35.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:35.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:35.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:35.433 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:35.433 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:35.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:35.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:36.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:36.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:36.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:36.491 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:36.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:36.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:36.543 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:36.553 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:36.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:36.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:36.602 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:36.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:36.643 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:36.643 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:36.658 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:36.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:36.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:36.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:36.701 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:36.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:36.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:36.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:37.660 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:37.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:37.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:37.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:37.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:37.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:37.811 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:37.821 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:37.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:37.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:37.870 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:37.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:37.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:37.911 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:37.928 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:37.928 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:37.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:37.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:37.968 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:37.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:37.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:37.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:38.929 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:38.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:38.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:39.026 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:39.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:39.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:39.078 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:39.088 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:39.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:39.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:39.137 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:39.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:39.167 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:39.167 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:39.193 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:39.193 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:39.193 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:39.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:39.224 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:39.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:39.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:39.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:40.194 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:40.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:40.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:40.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:40.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:40.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:40.343 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:40.354 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:40.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:40.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:40.401 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:40.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:40.440 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:40.440 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:40.459 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:40.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:40.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:40.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:40.497 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:40.498 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:40.498 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:40.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:41.461 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:41.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:41.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:41.559 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:41.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:41.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:41.612 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:41.622 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:41.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:41.671 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:41.671 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:41.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:41.711 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:41.711 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:41.728 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:41.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:41.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:41.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:41.769 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:41.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:41.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:41.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:42.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:42.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:42.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:42.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:42.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:42.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:42.878 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:42.889 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:42.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:42.938 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:42.938 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:42.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:42.974 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:42.974 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:42.994 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:42.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:42.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:42.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:43.032 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:43.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:43.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:43.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:43.997 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:43.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:43.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:44.095 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:44.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:44.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:44.147 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:44.158 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:44.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:44.206 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:44.206 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:44.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:44.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:44.229 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:44.263 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:44.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:44.264 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:44.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:44.287 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:44.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:44.287 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:44.287 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:45.265 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:45.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:45.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:45.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:45.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:45.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:45.416 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:45.426 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:45.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:45.475 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:45.475 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:45.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:45.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:45.503 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:45.531 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:45.531 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:45.531 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:45.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:45.559 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:45.559 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:45.559 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:45.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:46.532 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:46.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:46.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:46.630 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:46.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:46.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:46.682 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:46.692 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:46.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:46.741 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:46.742 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:46.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:46.783 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:46.783 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:46.798 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:46.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:46.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:46.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:46.841 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:46.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:46.842 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:46.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:47.800 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:47.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:47.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:47.899 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:47.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:47.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:47.951 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:47.961 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:48.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:48.010 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:48.010 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:48.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:48.046 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:48.046 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:48.067 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:48.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:48.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:48.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:48.103 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:48.104 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:48.104 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:48.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:49.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:49.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:49.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:49.167 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:49.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:49.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:49.219 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:49.229 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:49.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:49.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:49.278 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:49.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:49.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:49.306 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:49.334 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:49.334 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:49.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:49.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:49.362 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:49.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:49.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:49.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:50.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:50.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:50.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:50.435 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:50.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:50.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:50.487 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:50.497 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:50.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:50.546 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:50.546 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:50.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:50.586 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:50.587 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:50.604 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:50.604 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:50.604 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:50.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:50.644 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:50.644 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:50.644 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:50.644 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:51.605 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:51.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:51.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:51.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:51.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:51.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:51.756 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:51.767 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:51.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:51.814 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:51.814 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:51.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:51.845 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:51.845 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:51.871 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:51.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:51.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:51.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:51.902 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:51.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:51.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:51.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:52.873 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:52.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:52.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:52.972 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:52.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:52.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:53.024 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:53.034 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:53.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:53.083 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:53.083 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:53.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:53.108 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:53.109 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:53.140 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:53.140 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:53.140 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:53.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:53.165 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:53.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:53.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:53.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:54.141 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:54.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:54.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:54.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:54.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:54.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:54.292 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:54.302 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:54.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:54.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:54.350 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:54.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:54.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:54.377 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:54.408 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:54.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:54.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:54.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:54.434 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:54.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:54.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:54.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:55.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:55.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:55.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:55.505 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:55.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:55.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:55.556 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:55.566 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:55.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:55.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:55.615 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:55.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:55.644 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:55.644 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:55.673 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:55.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:55.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:55.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:55.701 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:55.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:55.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:55.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:56.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:56.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:56.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:56.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:56.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:56.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:56.824 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:56.834 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:56.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:56.883 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:56.884 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:56.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:56.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:56.910 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:56.941 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:56.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:56.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:56.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:56.968 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:56.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:56.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:56.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:57.942 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:57.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:57.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:58.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:58.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:58.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:58.093 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:58.103 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:58.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:58.149 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:58.149 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:58.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:58.188 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:58.188 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:58.206 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:58.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:58.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:58.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:58.246 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:58.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:58.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:58.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:59.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:59.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:59.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:59.307 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:59.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:59.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:59.359 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:07:59.370 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:07:59.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:07:59.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:59.378 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:07:59.435 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:59.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:59.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:59.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:59.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:07:59.454 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:59.454 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:07:59.511 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:59.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:59.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:59.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:00.435 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:00.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:00.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:00.499 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:00.512 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:00.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:00.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:00.576 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:00.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:00.584 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:00.584 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:00.641 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:00.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:00.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:00.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:00.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:00.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:00.652 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:00.710 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:00.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:00.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:00.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:01.642 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:01.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:01.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:01.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:01.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:01.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:01.787 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:01.798 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:01.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:01.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:01.847 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:01.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:01.875 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:01.875 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:01.902 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:01.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:01.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:01.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:01.932 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:01.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:01.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:01.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:02.903 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:02.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:02.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:02.985 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:02.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:02.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:03.037 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:03.048 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:03.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:03.097 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:03.097 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:03.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:03.123 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:03.123 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:03.154 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:03.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:03.154 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:03.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:03.180 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:03.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:03.180 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:03.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:04.155 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:04.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:04.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:04.254 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:04.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:04.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:04.306 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:04.317 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:04.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:04.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:04.365 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:04.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:04.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:04.409 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:04.421 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:04.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:04.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:04.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:04.467 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:04.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:04.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:04.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:05.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:05.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:05.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:05.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:05.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:05.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:05.573 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:05.584 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:05.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:05.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:05.633 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:05.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:05.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:05.669 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:05.690 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:05.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:05.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:05.690 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:05.725 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:05.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:05.726 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:05.726 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:06.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:06.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:06.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:06.790 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:06.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:06.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:06.842 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:06.852 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:06.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:06.900 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:06.900 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:06.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:06.935 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:06.935 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:06.957 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:06.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:06.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:06.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:06.993 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:06.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:06.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:06.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:07.958 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:07.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:07.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:08.056 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:08.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:08.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:08.109 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:08.119 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:08.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:08.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:08.126 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:08.183 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:08.183 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:08.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:08.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:08.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:08.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:08.203 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:08.260 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:08.260 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:08.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:08.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:09.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:08:09.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:09.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial127.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:09.283 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:08:09.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:09.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:08:09.335 DEBUG:teuthology.orchestra.run.trial127:> true 2026-02-12T22:08:09.345 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-12T22:08:09.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial127.front.sepia.ceph.com' 2026-02-12T22:08:09.393 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:09.394 DEBUG:teuthology.orchestra.run.trial127:> uname -r 2026-02-12T22:08:09.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-12T22:08:09.420 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:08:09.420 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-12T22:08:09.450 INFO:teuthology.orchestra.run.trial127.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:09.451 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:09.451 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:09.451 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:09.452 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:09.454 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:08:09.466 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:08:09.502 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_entire_dirfrags/yes prefetch_oft_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:08:09.502 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:08:09.584 INFO:teuthology.orchestra.run.trial119.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:08:09.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:08:09.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:08:09.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:08:09.620 INFO:teuthology.run:FAIL