2026-02-12T22:28:27.722 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:28:27.740 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:28:27.825 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47216 branch: wip-pdonnell-testing-20260210.171210 description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress traceless/50pc} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47216' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mds: mds inject traceless reply probability: 0.5 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNFi8djE0VYVRK9UBCEAHePM1imXWjDf71gbj1q928vG5LcOjeel9OIQG3Qkc28KP01uyD9Ma1EiEH4lKslWYk= trial109.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP18cNfzYy7CG9HD5SuSfN0S7mr3bmBiF0XZzKfQK10ltOUJCpss6oD6g+uqMLvnHDYF8/iBSedTzHjaAbrgRIY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:28:27.825 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:28:27.826 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:28:27.826 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:28:27.827 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:28:27.827 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:28:27.827 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:28:27.827 INFO:teuthology.packaging:ref: None 2026-02-12T22:28:27.827 INFO:teuthology.packaging:tag: None 2026-02-12T22:28:27.828 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:28:27.828 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:28:27.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:28:27.941 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:28:27.942 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:28:27.954 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:28:27.954 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:28:27.967 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:28:27.983 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:28:27.996 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:28:28.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial104.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47216', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:25:01.723135', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNFi8djE0VYVRK9UBCEAHePM1imXWjDf71gbj1q928vG5LcOjeel9OIQG3Qkc28KP01uyD9Ma1EiEH4lKslWYk='} 2026-02-12T22:28:28.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial109.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47216', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:25:01.722475', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP18cNfzYy7CG9HD5SuSfN0S7mr3bmBiF0XZzKfQK10ltOUJCpss6oD6g+uqMLvnHDYF8/iBSedTzHjaAbrgRIY='} 2026-02-12T22:28:28.125 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:28:28.136 INFO:teuthology.task.internal:roles: ubuntu@trial104.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:28:28.136 INFO:teuthology.task.internal:roles: ubuntu@trial109.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2026-02-12T22:28:28.136 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:28:28.271 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7de7313d2fc0>, signals=[15]) 2026-02-12T22:28:28.271 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:28:28.282 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:28:28.282 DEBUG:teuthology.task.internal:connecting to ubuntu@trial104.front.sepia.ceph.com 2026-02-12T22:28:28.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:28.343 DEBUG:teuthology.task.internal:connecting to ubuntu@trial109.front.sepia.ceph.com 2026-02-12T22:28:28.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:28:28.404 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:28:28.416 DEBUG:teuthology.orchestra.run.trial104:> uname -m 2026-02-12T22:28:28.433 INFO:teuthology.orchestra.run.trial104.stdout:x86_64 2026-02-12T22:28:28.433 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:NAME="Rocky Linux" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:ID="rocky" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="10.1" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;32" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:VENDOR_NAME="RESF" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:28:28.490 INFO:teuthology.orchestra.run.trial104.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:28:28.491 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:28:28.491 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:28:28.491 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server 2026-02-12T22:28:28.563 DEBUG:teuthology.orchestra.run.trial109:> uname -m 2026-02-12T22:28:28.580 INFO:teuthology.orchestra.run.trial109.stdout:x86_64 2026-02-12T22:28:28.580 DEBUG:teuthology.orchestra.run.trial109:> cat /etc/os-release 2026-02-12T22:28:28.636 INFO:teuthology.orchestra.run.trial109.stdout:NAME="Rocky Linux" 2026-02-12T22:28:28.636 INFO:teuthology.orchestra.run.trial109.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:28:28.636 INFO:teuthology.orchestra.run.trial109.stdout:ID="rocky" 2026-02-12T22:28:28.636 INFO:teuthology.orchestra.run.trial109.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:28:28.636 INFO:teuthology.orchestra.run.trial109.stdout:VERSION_ID="10.1" 2026-02-12T22:28:28.636 INFO:teuthology.orchestra.run.trial109.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:ANSI_COLOR="0;32" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:VENDOR_NAME="RESF" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:28:28.637 INFO:teuthology.orchestra.run.trial109.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:28:28.637 INFO:teuthology.lock.ops:Updating trial109.front.sepia.ceph.com on lock server 2026-02-12T22:28:28.714 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:28:28.732 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:28:28.744 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:28:28.744 DEBUG:teuthology.orchestra.run.trial104:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:28:28.746 DEBUG:teuthology.orchestra.run.trial109:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:28:28.762 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:28:28.773 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:28:28.773 DEBUG:teuthology.orchestra.run.trial104:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:28:28.802 DEBUG:teuthology.orchestra.run.trial109:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:28:28.817 INFO:teuthology.orchestra.run.trial104.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:28:28.820 INFO:teuthology.orchestra.run.trial109.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:28:28.821 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:28:28.979 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:28:28.998 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:28:28.998 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:28:28.998 DEBUG:teuthology.orchestra.run.trial104:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:28:28.998 DEBUG:teuthology.orchestra.run.trial109:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:28:29.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:28:29.014 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:28:29.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:28:29.014 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:28:29.071 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:29.071 INFO:teuthology.task.kernel:Running kernel on trial104: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:29.071 DEBUG:teuthology.orchestra.run.trial104:> sudo yum install -y kernel 2026-02-12T22:28:29.072 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:29.072 INFO:teuthology.task.kernel:Running kernel on trial109: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:28:29.072 DEBUG:teuthology.orchestra.run.trial109:> sudo yum install -y kernel 2026-02-12T22:28:29.575 INFO:teuthology.orchestra.run.trial104.stdout:Rocky Linux 10 - AppStream 21 MB/s | 2.2 MB 00:00 2026-02-12T22:28:29.601 INFO:teuthology.orchestra.run.trial109.stdout:Rocky Linux 10 - AppStream 17 MB/s | 2.2 MB 00:00 2026-02-12T22:28:29.943 INFO:teuthology.orchestra.run.trial104.stdout:Rocky Linux 10 - BaseOS 45 MB/s | 11 MB 00:00 2026-02-12T22:28:29.950 INFO:teuthology.orchestra.run.trial109.stdout:Rocky Linux 10 - BaseOS 49 MB/s | 11 MB 00:00 2026-02-12T22:28:30.433 INFO:teuthology.orchestra.run.trial109.stdout:Rocky Linux 10 - CRB 6.8 MB/s | 507 kB 00:00 2026-02-12T22:28:30.436 INFO:teuthology.orchestra.run.trial104.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 507 kB 00:00 2026-02-12T22:28:31.120 INFO:teuthology.orchestra.run.trial109.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 6.2 MB 00:00 2026-02-12T22:28:31.560 INFO:teuthology.orchestra.run.trial104.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 6.2 MB 00:01 2026-02-12T22:28:31.781 INFO:teuthology.orchestra.run.trial109.stdout:lab-extras 294 kB/s | 3.7 kB 00:00 2026-02-12T22:28:32.187 INFO:teuthology.orchestra.run.trial109.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:28:32.199 INFO:teuthology.orchestra.run.trial109.stdout:Dependencies resolved. 2026-02-12T22:28:32.200 INFO:teuthology.orchestra.run.trial109.stdout:================================================================================ 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: Package Arch Version Repo Size 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout:================================================================================ 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout:Installing: 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout:Installing dependencies: 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-12T22:28:32.201 INFO:teuthology.orchestra.run.trial109.stdout:Transaction Summary 2026-02-12T22:28:32.202 INFO:teuthology.orchestra.run.trial109.stdout:================================================================================ 2026-02-12T22:28:32.202 INFO:teuthology.orchestra.run.trial109.stdout:Install 5 Packages 2026-02-12T22:28:32.202 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-12T22:28:32.202 INFO:teuthology.orchestra.run.trial109.stdout:Total download size: 93 M 2026-02-12T22:28:32.202 INFO:teuthology.orchestra.run.trial109.stdout:Installed size: 135 M 2026-02-12T22:28:32.202 INFO:teuthology.orchestra.run.trial109.stdout:Downloading Packages: 2026-02-12T22:28:32.228 INFO:teuthology.orchestra.run.trial104.stdout:lab-extras 293 kB/s | 3.7 kB 00:00 2026-02-12T22:28:32.254 INFO:teuthology.orchestra.run.trial109.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:28:32.453 INFO:teuthology.orchestra.run.trial109.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 73 MB/s | 18 MB 00:00 2026-02-12T22:28:32.501 INFO:teuthology.orchestra.run.trial109.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 58 MB/s | 2.8 MB 00:00 2026-02-12T22:28:32.636 INFO:teuthology.orchestra.run.trial104.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:28:32.637 INFO:teuthology.orchestra.run.trial109.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 77 MB/s | 30 MB 00:00 2026-02-12T22:28:32.648 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-12T22:28:32.649 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-12T22:28:32.649 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repo Size 2026-02-12T22:28:32.649 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-12T22:28:32.649 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout:Installing dependencies: 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout:Install 5 Packages 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-12T22:28:32.650 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 93 M 2026-02-12T22:28:32.651 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 135 M 2026-02-12T22:28:32.651 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-12T22:28:32.707 INFO:teuthology.orchestra.run.trial104.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 24 MB/s | 1.4 MB 00:00 2026-02-12T22:28:32.748 INFO:teuthology.orchestra.run.trial109.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 74 MB/s | 41 MB 00:00 2026-02-12T22:28:32.749 INFO:teuthology.orchestra.run.trial109.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:28:32.750 INFO:teuthology.orchestra.run.trial109.stdout:Total 169 MB/s | 93 MB 00:00 2026-02-12T22:28:32.750 INFO:teuthology.orchestra.run.trial109.stdout:Running transaction check 2026-02-12T22:28:32.896 INFO:teuthology.orchestra.run.trial109.stdout:Transaction check succeeded. 2026-02-12T22:28:32.897 INFO:teuthology.orchestra.run.trial109.stdout:Running transaction test 2026-02-12T22:28:32.949 INFO:teuthology.orchestra.run.trial104.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 61 MB/s | 18 MB 00:00 2026-02-12T22:28:33.015 INFO:teuthology.orchestra.run.trial104.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 43 MB/s | 2.8 MB 00:00 2026-02-12T22:28:33.194 INFO:teuthology.orchestra.run.trial104.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 61 MB/s | 30 MB 00:00 2026-02-12T22:28:33.274 INFO:teuthology.orchestra.run.trial104.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 65 MB/s | 41 MB 00:00 2026-02-12T22:28:33.274 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:28:33.275 INFO:teuthology.orchestra.run.trial104.stdout:Total 148 MB/s | 93 MB 00:00 2026-02-12T22:28:33.275 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-12T22:28:33.298 INFO:teuthology.orchestra.run.trial109.stdout:Transaction test succeeded. 2026-02-12T22:28:33.298 INFO:teuthology.orchestra.run.trial109.stdout:Running transaction 2026-02-12T22:28:33.422 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-12T22:28:33.422 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-12T22:28:33.825 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-12T22:28:33.826 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-12T22:28:33.995 INFO:teuthology.orchestra.run.trial109.stdout: Preparing : 1/1 2026-02-12T22:28:34.197 INFO:teuthology.orchestra.run.trial109.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:28:34.218 INFO:teuthology.orchestra.run.trial109.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:28:34.522 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-12T22:28:34.723 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:28:34.744 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:28:35.480 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:28:35.508 INFO:teuthology.orchestra.run.trial109.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:28:35.995 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:28:36.023 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:28:37.352 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:28:37.358 INFO:teuthology.orchestra.run.trial109.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:28:37.874 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:28:37.879 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:28:39.217 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:28:39.227 INFO:teuthology.orchestra.run.trial109.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:28:39.740 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:28:39.750 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:28:41.097 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:28:41.613 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:14.944 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:14.967 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout:Installed: 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-12T22:29:15.201 INFO:teuthology.orchestra.run.trial109.stdout:Complete! 2026-02-12T22:29:15.242 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:15.266 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:15.270 DEBUG:teuthology.orchestra.run.trial109:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:29:15.305 INFO:teuthology.orchestra.run.trial109.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.306 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.306 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.306 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:29:15.306 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:29:15.307 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:29:15.307 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial109.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:29:15.307 DEBUG:teuthology.orchestra.run.trial109:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:29:15.379 INFO:teuthology.orchestra.run.trial109.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.380 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.380 DEBUG:teuthology.orchestra.run.trial109:> sudo rpm -qi grub2-tools 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Name : grub2-tools 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Epoch : 1 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Version : 2.12 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Release : 29.el10_1 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Architecture: x86_64 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:29:15.451 INFO:teuthology.orchestra.run.trial109.stdout:Group : Unspecified 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Size : 7963769 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:License : GPL-3.0-or-later 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Signature : 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Packager : Release Engineering 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Summary : Support tools for GRUB. 2026-02-12T22:29:15.452 INFO:teuthology.orchestra.run.trial109.stdout:Description : 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout:hardware devices. 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout: 2026-02-12T22:29:15.453 INFO:teuthology.orchestra.run.trial109.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:29:15.454 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:29:15.454 INFO:teuthology.task.kernel:Updating grub on trial109 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.454 DEBUG:teuthology.orchestra.run.trial109:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.500 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.501 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.501 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-12T22:29:15.501 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-12T22:29:15.519 INFO:teuthology.orchestra.run.trial109.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:29:15.520 DEBUG:teuthology.orchestra.run.trial109:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:29:15.565 DEBUG:teuthology.orchestra.run.trial104:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:29:15.585 INFO:teuthology.orchestra.run.trial109.stdout:/sbin/grubby 2026-02-12T22:29:15.587 INFO:teuthology.orchestra.run.trial109.stdout:yes 2026-02-12T22:29:15.587 DEBUG:teuthology.orchestra.run.trial109:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:29:15.599 INFO:teuthology.orchestra.run.trial104.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.600 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.600 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:29:15.600 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:29:15.600 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:29:15.600 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial104.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:29:15.600 DEBUG:teuthology.orchestra.run.trial104:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:29:15.652 INFO:teuthology.orchestra.run.trial109.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:29:15.653 DEBUG:teuthology.orchestra.run.trial109:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.673 INFO:teuthology.orchestra.run.trial104.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.674 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.675 DEBUG:teuthology.orchestra.run.trial104:> sudo rpm -qi grub2-tools 2026-02-12T22:29:15.728 DEBUG:teuthology.orchestra.run.trial109:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:29:15.746 INFO:teuthology.orchestra.run.trial104.stdout:Name : grub2-tools 2026-02-12T22:29:15.746 INFO:teuthology.orchestra.run.trial104.stdout:Epoch : 1 2026-02-12T22:29:15.746 INFO:teuthology.orchestra.run.trial104.stdout:Version : 2.12 2026-02-12T22:29:15.746 INFO:teuthology.orchestra.run.trial104.stdout:Release : 29.el10_1 2026-02-12T22:29:15.746 INFO:teuthology.orchestra.run.trial104.stdout:Architecture: x86_64 2026-02-12T22:29:15.746 INFO:teuthology.orchestra.run.trial104.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Group : Unspecified 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Size : 7963769 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:License : GPL-3.0-or-later 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Signature : 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Packager : Release Engineering 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:29:15.747 INFO:teuthology.orchestra.run.trial104.stdout:Summary : Support tools for GRUB. 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout:Description : 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout:hardware devices. 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-12T22:29:15.748 INFO:teuthology.orchestra.run.trial104.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:29:15.749 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:29:15.749 INFO:teuthology.task.kernel:Updating grub on trial104 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:15.749 DEBUG:teuthology.orchestra.run.trial104:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:29:15.815 INFO:teuthology.orchestra.run.trial104.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:29:15.816 DEBUG:teuthology.orchestra.run.trial104:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:29:15.838 INFO:teuthology.orchestra.run.trial109.stderr:Generating grub configuration file ... 2026-02-12T22:29:15.882 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/grubby 2026-02-12T22:29:15.883 INFO:teuthology.orchestra.run.trial104.stdout:yes 2026-02-12T22:29:15.884 DEBUG:teuthology.orchestra.run.trial104:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:29:15.951 INFO:teuthology.orchestra.run.trial104.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:29:15.952 DEBUG:teuthology.orchestra.run.trial104:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:16.015 INFO:teuthology.orchestra.run.trial109.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:29:16.025 INFO:teuthology.orchestra.run.trial109.stderr:done 2026-02-12T22:29:16.027 DEBUG:teuthology.orchestra.run.trial109:> test -d /sys/firmware/efi 2026-02-12T22:29:16.029 DEBUG:teuthology.orchestra.run.trial104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:29:16.045 DEBUG:teuthology.orchestra.run.trial109:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:29:16.113 INFO:teuthology.orchestra.run.trial109.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:29:16.113 INFO:teuthology.orchestra.run.trial109.stdout:/boot/efi/EFI/rocky 2026-02-12T22:29:16.114 DEBUG:teuthology.orchestra.run.trial109:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:29:16.138 INFO:teuthology.orchestra.run.trial104.stderr:Generating grub configuration file ... 2026-02-12T22:29:16.182 INFO:teuthology.orchestra.run.trial109.stdout:no 2026-02-12T22:29:16.183 DEBUG:teuthology.orchestra.run.trial109:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:29:16.249 INFO:teuthology.orchestra.run.trial109.stdout:yes 2026-02-12T22:29:16.249 DEBUG:teuthology.orchestra.run.trial109:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:29:16.311 INFO:teuthology.orchestra.run.trial104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:29:16.316 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial109 2026-02-12T22:29:16.316 DEBUG:teuthology.orchestra.run.trial109:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:29:16.320 INFO:teuthology.orchestra.run.trial104.stderr:done 2026-02-12T22:29:16.322 DEBUG:teuthology.orchestra.run.trial104:> test -d /sys/firmware/efi 2026-02-12T22:29:16.339 DEBUG:teuthology.orchestra.run.trial104:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:29:16.382 INFO:teuthology.orchestra.run.trial109.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:29:16.408 INFO:teuthology.orchestra.run.trial104.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:29:16.408 INFO:teuthology.orchestra.run.trial104.stdout:/boot/efi/EFI/rocky 2026-02-12T22:29:16.410 DEBUG:teuthology.orchestra.run.trial104:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:29:16.478 INFO:teuthology.orchestra.run.trial104.stdout:no 2026-02-12T22:29:16.478 DEBUG:teuthology.orchestra.run.trial104:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:29:16.545 INFO:teuthology.orchestra.run.trial104.stdout:yes 2026-02-12T22:29:16.546 DEBUG:teuthology.orchestra.run.trial104:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:29:16.612 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial104 2026-02-12T22:29:16.613 DEBUG:teuthology.orchestra.run.trial104:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:29:16.677 INFO:teuthology.orchestra.run.trial104.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:29:46.358 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:46.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:46.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:46.469 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:46.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:46.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:46.560 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:46.617 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:46.618 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:46.618 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:46.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:46.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:46.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:46.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:46.764 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:46.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:46.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:46.851 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:46.908 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:46.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:46.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:46.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:47.620 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:47.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:47.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:47.730 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:47.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:47.803 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:47.803 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:47.860 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:47.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:47.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:47.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:47.911 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:47.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:47.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:47.992 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:48.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:48.065 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:48.065 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:48.122 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:48.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:48.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:48.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:48.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:48.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:48.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:48.922 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:48.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:48.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:48.999 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:49.055 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:49.056 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:49.056 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:49.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:49.123 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:49.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:49.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:49.227 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:49.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:49.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:49.316 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:49.373 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:49.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:49.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:49.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:50.057 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:50.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:50.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:50.166 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:50.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:50.242 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:50.242 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:50.300 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:50.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:50.300 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:50.300 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:50.375 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:50.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:50.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:50.436 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:50.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:50.511 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:50.511 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:50.568 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:50.568 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:50.568 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:50.568 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:51.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:51.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:51.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:51.363 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:51.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:51.435 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:51.436 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:51.493 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:51.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:51.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:51.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:51.569 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:51.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:51.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:51.678 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:51.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:51.765 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:51.765 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:51.823 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:51.823 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:51.823 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:51.823 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:52.495 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:52.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:52.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:52.603 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:52.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:52.681 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:52.681 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:52.738 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:52.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:52.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:52.739 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:52.825 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:52.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:52.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:52.932 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:53.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:53.007 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:53.008 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:53.063 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:53.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:53.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:53.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:53.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:53.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:53.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:53.802 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:53.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:53.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:53.884 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:53.941 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:53.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:53.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:53.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:54.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:54.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:54.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:54.124 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:54.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:54.196 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:54.196 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:54.252 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:54.252 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:54.252 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:54.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:54.942 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:54.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:54.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:55.003 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:55.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:55.079 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:55.079 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:55.136 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:55.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:55.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:55.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:55.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:55.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:55.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:55.312 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:55.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:55.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:55.385 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:55.442 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:55.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:55.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:55.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:56.137 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:56.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:56.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:56.199 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:56.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:56.275 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:56.275 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:56.332 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:56.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:56.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:56.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:56.444 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:56.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:56.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:56.503 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:56.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:56.587 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:56.587 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:56.643 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:56.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:56.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:56.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:57.333 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:57.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:57.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:57.393 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:57.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:57.468 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:57.468 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:57.524 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:57.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:57.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:57.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:57.644 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:57.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:57.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:57.703 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:57.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:57.780 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:57.780 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:57.838 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:57.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:57.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:57.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:58.526 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:58.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:58.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:58.634 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:58.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:58.714 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:58.714 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:29:58.772 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:58.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:58.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:58.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:58.838 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:29:58.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:58.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:58.945 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:29:59.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:29:59.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:59.018 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:29:59.074 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:29:59.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:29:59.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:29:59.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:29:59.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:29:59.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:59.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:29:59.883 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:29:59.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:29:59.963 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:29:59.963 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:00.020 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:00.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:00.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:00.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:00.076 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:00.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:00.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:00.182 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:00.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:00.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:00.259 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:00.316 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:00.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:00.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:00.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:01.023 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:01.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:01.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:01.132 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:01.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:01.211 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:01.211 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:01.268 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:01.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:01.269 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:01.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:01.318 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:01.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:01.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:01.424 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:01.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:01.499 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:01.499 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:01.556 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:01.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:01.557 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:01.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:02.271 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:02.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:02.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:02.380 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:02.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:02.454 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:02.454 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:02.511 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:02.511 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:02.511 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:02.511 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:02.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:02.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:02.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:02.665 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:02.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:02.741 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:02.742 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:02.798 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:02.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:02.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:02.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:03.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:03.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:03.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:03.622 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:03.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:03.701 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:03.701 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:03.758 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:03.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:03.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:03.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:03.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:03.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:03.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:03.904 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:03.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:03.977 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:03.977 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:04.035 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:04.035 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:04.035 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:04.036 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:04.761 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:04.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:04.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:04.833 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:04.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:04.915 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:04.915 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:04.972 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:04.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:04.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:04.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:05.036 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:05.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:05.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:05.096 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:05.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:05.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:05.169 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:05.226 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:05.227 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:05.227 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:05.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:05.973 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:05.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:05.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:06.083 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:06.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:06.166 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:06.167 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:06.224 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:06.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:06.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:06.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:06.227 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:06.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:06.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:06.364 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:06.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:06.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:06.451 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:06.508 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:06.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:06.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:06.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:07.226 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:07.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:07.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:07.336 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:07.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:07.417 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:07.417 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:07.474 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:07.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:07.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:07.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:07.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:07.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:07.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:07.637 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:07.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:07.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:07.714 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:07.773 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:07.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:07.774 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:07.774 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:08.475 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:08.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:08.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:08.544 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:08.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:08.640 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:08.640 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:08.696 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:08.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:08.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:08.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:08.775 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:08.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:08.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:08.874 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:08.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:08.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:08.949 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:09.005 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:09.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:09.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:09.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:09.697 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:09.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:09.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:09.776 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:09.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:09.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:09.850 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:09.908 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:09.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:09.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:09.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:10.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:10.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:10.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:10.113 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:10.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:10.184 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:10.185 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:10.242 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:10.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:10.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:10.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:10.910 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:10.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:10.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:11.019 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:11.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:11.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:11.104 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:11.161 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:11.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:11.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:11.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:11.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:11.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:11.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:11.350 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:11.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:11.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:11.430 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:11.488 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:11.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:11.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:11.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:12.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:12.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:12.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:12.272 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:12.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:12.352 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:12.352 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:12.410 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:12.410 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:12.410 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:12.410 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:12.489 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:12.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:12.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:12.596 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:12.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:12.672 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:12.672 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:12.729 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:12.729 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:12.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:12.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:13.412 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:13.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:13.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:13.519 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:13.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:13.605 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:13.605 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:13.662 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:13.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:13.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:13.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:13.731 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:13.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:13.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:13.838 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:13.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:13.925 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:13.925 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:13.982 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:13.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:13.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:13.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:14.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:14.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:14.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:14.773 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:14.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:14.852 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:14.852 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:14.909 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:14.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:14.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:14.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:14.984 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:14.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:14.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:15.092 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:15.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:15.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:15.174 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:15.231 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:15.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:15.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:15.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:15.911 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:15.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:15.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:16.019 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:16.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:16.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:16.102 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:16.160 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:16.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:16.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:16.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:16.232 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:16.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:16.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:16.339 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:16.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:16.423 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:16.423 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:16.480 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:16.481 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:16.481 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:16.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:17.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:17.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:17.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:17.271 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:17.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:17.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:17.359 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:17.416 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:17.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:17.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:17.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:17.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:17.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:17.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:17.589 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:17.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:17.675 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:17.675 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:17.732 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:17.732 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:17.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:17.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:18.418 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:18.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:18.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:18.527 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:18.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:18.609 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:18.609 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:18.667 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:18.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:18.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:18.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:18.733 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:18.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:18.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:18.867 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:18.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:18.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:18.952 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:19.009 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:19.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:19.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:19.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:19.669 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:19.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:19.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:19.778 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:19.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:19.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:19.858 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:19.915 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:19.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:19.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:19.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:20.009 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:20.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:20.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:20.142 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:20.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:20.223 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:20.223 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:20.281 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:20.281 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:20.281 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:20.281 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:20.918 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:20.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:20.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:21.027 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:21.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:21.102 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:21.103 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:21.160 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:21.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:21.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:21.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:21.282 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:21.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:21.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:21.391 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:21.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:21.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:21.463 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:21.522 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:21.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:21.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:21.523 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:22.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:22.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:22.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:22.229 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:22.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:22.306 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:22.306 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:22.363 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:22.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:22.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:22.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:22.524 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:22.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:22.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:22.630 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:22.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:22.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:22.705 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:22.762 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:22.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:22.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:22.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:23.365 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:23.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:23.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:23.474 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:23.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:23.560 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:23.560 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:23.618 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:23.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:23.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:23.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:23.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:23.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:23.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:23.873 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:23.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:23.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:23.959 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:24.017 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:24.017 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:24.017 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:24.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:24.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:24.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:24.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:24.684 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:24.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:24.756 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:24.756 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:24.813 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:24.813 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:24.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:24.814 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:25.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:25.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:25.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:25.126 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:25.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:25.199 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:25.199 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:25.256 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:25.256 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:25.257 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:25.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:25.814 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:25.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:25.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:25.880 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:25.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:25.953 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:25.953 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:26.010 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:26.010 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:26.010 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:26.010 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:26.258 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:26.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:26.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:26.365 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:26.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:26.442 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:26.442 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:26.499 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:26.500 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:26.500 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:26.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:27.011 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:27.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:27.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:27.101 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:27.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:27.172 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:27.173 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:27.230 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:27.238 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:27.238 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:27.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:27.501 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:27.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:27.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:27.608 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:27.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:27.696 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:27.696 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:27.753 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:27.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:27.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:27.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:28.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:28.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:28.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:28.321 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:28.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:28.406 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:28.406 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:28.462 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:28.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:28.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:28.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:28.755 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:28.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:28.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:28.862 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:28.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:28.937 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:28.937 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:28.994 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:28.995 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:28.995 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:28.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:29.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:29.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:29.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:29.573 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:29.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:29.658 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:29.658 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:29.716 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:29.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:29.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:29.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:29.996 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:29.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:29.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:30.104 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:30.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:30.185 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:30.185 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:30.242 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:30.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:30.243 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:30.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:30.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:30.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:30.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:30.829 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:30.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:30.915 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:30.915 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:30.972 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:30.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:30.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:30.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:31.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:31.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:31.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:31.353 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:31.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:31.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:31.430 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:31.487 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:31.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:31.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:31.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:31.974 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:31.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:31.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:32.083 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:32.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:32.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:32.168 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:32.224 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:32.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:32.225 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:32.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:32.489 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:32.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:32.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:32.597 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:32.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:32.678 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:32.679 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:32.736 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:32.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:32.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:32.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:33.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:33.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:33.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:33.335 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:33.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:33.405 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:33.405 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:33.463 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:33.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:33.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:33.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:33.738 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:33.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:33.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:33.846 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:33.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:33.927 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:33.927 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:33.984 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:33.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:33.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:33.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:34.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:34.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:34.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:34.574 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:34.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:34.657 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:34.657 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:34.715 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:34.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:34.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:34.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:34.985 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:34.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:34.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:35.093 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:35.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:35.167 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:35.167 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:35.224 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:35.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:35.225 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:35.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:35.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:35.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:35.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:35.825 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:35.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:35.897 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:35.898 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:35.955 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:35.955 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:35.955 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:35.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:36.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:36.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:36.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:36.334 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:36.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:36.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:36.409 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:36.466 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:36.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:36.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:36.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:36.957 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:36.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:36.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:37.067 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:37.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:37.150 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:37.150 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:37.206 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:37.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:37.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:37.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:37.468 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:37.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:37.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:37.581 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:37.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:37.657 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:37.657 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:37.714 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:37.714 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:37.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:37.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:38.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:38.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:38.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:38.317 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:38.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:38.405 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:38.405 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:38.462 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:38.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:38.463 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:38.463 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:38.716 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:38.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:38.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:38.822 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:38.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:38.912 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:38.912 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:38.968 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:38.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:38.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:38.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:39.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:39.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:39.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:39.573 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:39.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:39.658 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:39.659 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:39.716 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:39.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:39.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:39.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:39.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:39.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:39.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:40.077 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:40.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:40.164 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:40.164 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:40.220 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:40.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:40.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:40.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:40.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:40.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:40.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:40.827 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:40.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:40.904 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:40.904 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:40.962 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:40.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:40.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:40.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:41.222 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:41.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:41.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:41.330 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:41.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:41.405 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:41.405 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:41.462 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:41.462 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:41.462 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:41.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:41.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:41.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:41.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:42.074 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:42.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:42.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:42.155 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:42.212 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:42.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:42.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:42.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:42.464 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:42.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:42.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:42.571 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:42.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:42.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:42.647 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:42.703 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:42.704 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:42.704 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:42.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:43.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:43.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:43.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:43.322 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:43.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:43.408 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:43.408 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:43.467 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:43.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:43.467 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:43.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:43.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:43.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:43.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:43.812 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:43.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:43.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:43.899 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:43.956 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:43.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:43.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:43.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:44.468 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:44.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:44.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:44.577 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:44.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:44.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:44.659 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:44.716 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:44.716 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:44.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:44.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:44.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:44.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:44.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:45.066 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:45.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:45.141 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:45.141 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:45.199 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:45.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:45.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:45.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:45.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:45.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:45.826 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:45.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:45.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:45.902 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:45.959 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:45.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:45.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:45.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:46.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:46.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:46.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:46.262 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:46.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:46.353 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:46.353 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:46.410 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:46.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:46.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:46.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:46.961 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:46.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:46.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:47.070 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:47.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:47.146 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:47.146 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:47.203 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:47.204 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:47.204 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:47.204 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:47.413 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:47.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:47.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:47.520 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:47.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:47.595 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:47.595 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:47.652 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:47.652 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:47.652 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:47.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:48.205 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:48.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:48.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:48.314 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:48.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:48.387 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:48.387 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:48.444 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:48.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:48.445 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:48.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:48.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:48.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:48.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:48.762 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:48.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:48.834 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:48.834 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:48.891 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:48.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:48.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:48.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:49.446 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:49.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:49.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:49.555 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:49.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:49.635 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:49.635 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:49.692 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:49.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:49.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:49.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:49.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:49.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:49.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:50.001 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:50.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:50.077 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:50.078 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:50.136 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:50.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:50.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:50.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:50.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:50.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:50.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:50.804 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:50.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:50.875 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:50.875 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:50.932 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:50.933 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:50.933 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:50.933 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:51.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:51.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:51.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:51.246 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:51.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:51.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:51.323 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:51.380 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:51.381 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:51.381 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:51.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:51.934 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:51.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:51.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:52.044 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:52.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:52.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:52.130 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:52.188 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:52.189 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:52.189 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:52.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:52.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:52.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:52.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:52.490 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:52.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:52.568 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:52.569 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:52.625 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:52.626 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:52.626 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:52.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:53.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:53.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:53.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:53.302 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:53.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:53.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:53.385 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:53.442 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:53.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:53.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:53.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:53.627 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:53.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:53.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:53.734 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:53.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:53.826 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:53.826 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:53.883 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:53.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:53.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:53.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:54.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:54.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:54.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:54.527 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:54.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:54.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:54.613 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:54.670 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:54.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:54.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:54.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:54.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:54.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:54.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:54.991 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:55.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:55.070 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:55.070 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:55.127 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:55.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:55.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:55.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:55.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:55.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:55.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:55.780 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:55.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:55.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:55.860 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:55.917 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:55.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:55.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:55.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:56.129 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:56.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:56.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:56.237 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:56.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:56.314 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:56.314 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:56.371 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:56.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:56.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:56.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:56.919 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:56.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:56.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:57.028 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:57.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:57.108 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:57.108 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:57.165 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:57.165 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:57.165 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:57.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:57.373 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:57.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:57.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:57.480 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:57.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:57.562 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:57.563 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:57.619 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:57.620 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:57.620 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:57.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:58.166 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:58.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:58.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:58.274 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:58.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:58.354 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:58.355 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:58.411 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:58.411 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:58.411 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:58.411 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:58.621 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:58.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:58.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:58.729 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:30:58.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:58.813 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:58.814 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:30:58.871 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:58.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:58.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:58.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:59.413 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:30:59.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:59.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:59.521 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:30:59.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:30:59.597 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:30:59.597 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:30:59.654 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:30:59.654 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:30:59.654 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:30:59.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:30:59.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:30:59.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:30:59.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:30:59.981 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:00.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:00.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:00.056 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:00.114 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:00.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:00.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:00.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:00.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:00.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:00.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:00.766 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:00.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:00.843 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:00.843 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:00.901 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:00.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:00.901 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:00.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:01.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:01.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:01.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:01.224 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:01.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:01.303 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:01.304 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:01.361 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:01.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:01.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:01.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:01.902 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:01.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:01.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:02.011 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:02.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:02.087 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:02.088 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:02.144 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:02.144 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:02.144 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:02.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:02.363 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:02.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:02.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:02.470 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:02.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:02.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:02.550 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:02.607 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:02.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:02.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:02.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:03.146 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:03.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:03.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:03.255 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:03.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:03.335 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:03.335 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:03.393 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:03.393 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:03.393 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:03.393 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:03.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:03.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:03.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:03.714 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:03.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:03.791 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:03.792 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:03.849 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:03.850 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:03.850 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:03.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:04.395 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:04.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:04.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:04.457 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:04.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:04.532 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:04.532 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:04.589 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:04.590 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:04.590 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:04.590 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:04.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:04.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:04.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:04.958 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:05.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:05.035 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:05.035 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:05.092 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:05.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:05.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:05.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:05.591 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:05.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:05.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:05.663 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:05.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:05.738 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:05.738 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:05.796 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:05.796 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:05.796 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:05.796 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:06.093 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:06.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:06.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:06.200 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:06.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:06.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:06.275 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:06.332 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:06.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:06.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:06.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:06.797 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:06.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:06.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:06.859 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:06.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:06.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:06.934 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:06.991 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:06.991 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:06.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:06.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:07.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:07.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:07.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:07.443 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:07.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:07.529 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:07.529 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:07.586 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:07.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:07.587 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:07.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:07.992 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:07.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:07.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:08.103 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:08.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:08.177 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:08.177 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:08.236 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:08.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:08.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:08.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:08.588 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:08.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:08.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:08.697 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:08.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:08.772 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:08.772 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:08.829 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:08.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:08.830 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:08.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:09.238 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:09.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:09.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:09.348 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:09.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:09.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:09.430 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:09.487 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:09.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:09.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:09.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:09.831 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:09.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:09.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:09.939 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:10.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:10.014 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:10.015 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:10.073 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:10.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:10.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:10.074 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:10.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:10.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:10.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:10.597 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:10.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:10.678 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:10.678 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:10.736 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:10.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:10.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:10.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:11.075 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:11.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:11.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:11.182 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:11.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:11.274 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:11.274 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:11.331 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:11.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:11.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:11.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:11.737 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:11.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:11.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:11.846 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:11.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:11.920 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:11.920 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:11.977 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:11.977 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:11.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:11.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:12.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:12.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:12.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:12.431 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:12.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:12.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:12.505 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:12.562 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:12.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:12.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:12.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:12.979 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:12.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:12.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:13.088 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:13.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:13.165 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:13.166 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:13.223 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:13.223 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:13.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:13.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:13.564 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:13.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:13.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:13.671 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:13.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:13.752 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:13.752 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:13.809 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:13.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:13.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:13.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:14.225 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:14.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:14.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:14.333 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:14.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:14.418 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:14.418 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:14.475 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:14.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:14.476 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:14.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:14.811 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:14.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:14.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:14.918 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:14.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:14.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:14.988 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:15.045 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:15.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:15.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:15.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:15.477 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:15.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:15.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:15.588 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:15.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:15.666 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:15.666 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:15.723 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:15.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:15.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:15.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:16.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:16.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:16.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:16.154 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:16.237 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:16.237 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:16.237 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:16.294 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:16.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:16.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:16.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:16.725 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:16.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:16.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:16.832 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:16.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:16.921 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:16.921 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:16.979 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:16.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:16.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:16.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:17.296 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:17.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:17.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:17.400 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:17.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:17.476 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:17.477 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:17.534 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:17.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:17.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:17.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:17.981 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:17.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:17.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:18.090 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:18.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:18.167 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:18.167 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:18.224 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:18.224 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:18.224 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:18.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:18.536 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:18.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:18.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:18.643 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:18.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:18.732 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:18.732 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:18.789 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:18.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:18.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:18.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:19.225 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:19.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:19.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:19.335 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:19.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:19.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:19.420 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:19.477 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:19.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:19.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:19.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:19.791 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:19.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:19.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:19.899 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:19.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:19.989 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:19.989 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:20.046 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:20.047 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:20.047 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:20.047 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:20.480 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:20.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:20.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:20.589 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:20.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:20.667 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:20.667 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:20.724 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:20.724 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:20.724 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:20.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:21.048 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:21.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:21.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:21.155 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:21.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:21.244 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:21.244 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:21.301 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:21.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:21.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:21.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:21.725 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:21.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:21.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:21.835 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:21.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:21.915 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:21.915 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:21.972 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:21.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:21.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:21.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:22.303 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:22.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:22.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:22.409 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:22.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:22.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:22.483 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:22.540 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:22.541 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:22.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:22.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:22.973 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:22.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:22.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:23.084 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:23.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:23.168 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:23.168 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:23.225 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:23.225 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:23.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:23.226 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:23.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:23.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:23.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:23.650 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:23.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:23.725 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:23.725 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:23.782 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:23.782 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:23.783 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:23.783 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:24.227 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:24.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:24.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:24.336 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:24.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:24.411 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:24.411 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:24.468 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:24.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:24.469 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:24.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:24.784 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:24.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:24.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:24.891 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:24.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:24.968 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:24.968 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:25.024 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:25.024 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:25.025 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:25.025 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:25.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:25.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:25.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:25.580 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:25.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:25.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:25.659 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:25.716 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:25.717 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:25.717 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:25.717 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:26.026 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:26.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:26.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:26.134 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:26.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:26.216 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:26.216 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:26.273 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:26.273 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:26.273 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:26.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:26.718 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:26.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:26.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:26.785 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:26.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:26.856 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:26.857 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:26.914 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:26.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:26.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:26.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:27.275 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:27.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:27.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:27.383 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:27.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:27.468 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:27.468 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:27.525 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:27.526 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:27.526 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:27.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:27.915 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:27.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:27.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:28.024 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:28.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:28.105 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:28.105 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:28.162 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:28.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:28.162 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:28.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:28.528 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:28.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:28.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:28.635 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:28.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:28.713 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:28.713 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:28.770 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:28.770 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:28.770 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:28.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:29.164 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:29.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:29.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:29.273 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:29.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:29.347 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:29.348 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:29.406 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:29.406 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:29.407 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:29.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:29.772 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:29.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:29.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:29.879 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:29.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:29.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:29.955 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:30.013 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:30.014 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:30.014 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:30.014 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:30.408 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:30.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:30.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:30.474 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:30.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:30.549 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:30.550 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:30.607 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:30.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:30.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:30.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:31.016 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:31.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:31.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:31.123 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:31.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:31.217 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:31.217 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:31.274 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:31.274 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:31.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:31.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:31.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:31.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:31.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:31.711 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:31.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:31.782 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:31.782 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:31.839 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:31.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:31.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:31.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:32.276 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:32.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:32.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:32.383 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:32.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:32.460 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:32.460 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:32.517 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:32.517 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:32.517 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:32.517 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:32.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:32.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:32.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:32.960 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:33.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:33.033 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:33.033 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:33.090 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:33.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:33.090 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:33.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:33.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:33.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:33.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:33.627 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:33.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:33.711 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:33.711 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:33.768 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:33.769 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:33.769 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:33.769 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:34.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:34.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:34.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:34.201 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:34.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:34.284 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:34.284 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:34.341 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:34.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:34.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:34.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:34.771 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:34.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:34.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:34.877 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:34.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:34.964 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:34.964 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:35.021 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:35.022 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:35.022 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:35.022 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:35.343 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:35.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:35.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:35.453 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:35.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:35.528 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:35.528 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:35.585 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:35.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:35.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:35.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:36.023 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:36.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:36.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:36.130 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:36.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:36.211 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:36.211 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:36.268 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:36.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:36.269 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:36.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:36.587 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:36.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:36.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:36.648 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:36.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:36.721 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:36.721 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:36.777 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:36.777 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:36.777 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:36.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:37.271 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:37.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:37.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:37.330 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:37.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:37.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:37.418 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:37.474 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:37.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:37.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:37.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:37.778 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:37.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:37.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:37.839 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:37.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:37.921 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:37.921 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:37.978 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:37.978 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:37.978 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:37.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:38.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:38.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:38.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:38.609 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:38.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:38.683 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:38.683 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:38.742 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:38.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:38.742 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:38.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:38.979 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:38.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:38.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:39.087 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:39.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:39.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:39.160 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:39.217 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:39.218 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:39.218 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:39.218 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:39.743 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:39.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:39.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:39.850 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:39.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:39.926 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:39.926 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:39.983 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:39.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:39.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:39.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:40.220 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:40.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:40.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:40.329 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:40.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:40.416 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:40.416 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:40.473 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:40.473 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:40.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:40.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:40.986 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:40.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:40.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:41.095 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:41.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:41.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:41.177 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:41.234 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:41.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:41.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:41.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:41.475 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:41.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:41.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:41.596 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:41.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:41.678 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:41.678 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:41.736 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:41.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:41.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:41.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:42.235 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:42.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:42.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:42.343 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:42.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:42.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:42.416 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:42.473 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:42.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:42.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:42.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:42.738 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:42.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:42.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:42.831 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:42.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:42.908 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:42.909 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:42.966 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:42.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:42.966 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:42.966 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:43.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:43.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:43.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:43.582 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:43.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:43.666 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:43.666 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:43.722 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:43.723 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:43.723 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:43.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:43.968 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:43.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:43.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:44.079 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:44.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:44.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:44.154 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:44.212 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:44.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:44.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:44.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:44.724 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:44.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:44.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:44.832 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:44.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:44.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:44.910 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:44.967 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:44.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:44.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:44.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:45.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:45.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:45.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:45.326 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:45.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:45.403 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:45.403 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:45.460 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:45.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:45.460 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:45.460 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:45.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:45.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:45.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:46.078 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:46.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:46.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:46.159 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:46.216 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:46.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:46.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:46.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:46.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:46.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:46.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:46.572 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:46.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:46.648 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:46.648 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:46.705 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:46.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:46.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:46.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:47.218 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:47.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:47.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:47.326 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:47.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:47.413 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:47.414 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:47.471 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:47.471 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:47.471 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:47.472 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:47.707 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:47.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:47.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:47.816 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:47.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:47.905 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:47.905 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:47.962 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:47.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:47.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:47.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:48.473 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:48.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:48.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:48.581 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:48.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:48.668 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:48.669 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:48.726 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:48.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:48.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:48.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:48.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:48.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:48.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:49.073 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:49.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:49.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:49.160 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:49.207 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:49.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:49.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:49.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:49.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:49.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:49.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:49.834 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:49.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:49.909 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:49.909 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:49.966 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:49.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:49.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:49.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:50.208 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:50.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:50.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:50.317 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:50.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:50.390 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:50.390 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:50.448 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:50.448 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:50.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:50.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:50.968 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:50.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:50.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:51.076 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:51.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:51.163 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:51.163 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:51.220 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:51.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:51.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:51.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:51.450 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:51.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:51.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:51.559 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:51.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:51.635 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:51.635 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:51.692 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:51.692 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:51.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:51.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:52.222 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:52.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:52.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:52.329 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:52.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:52.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:52.403 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:52.460 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:52.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:52.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:52.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:52.694 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:52.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:52.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:52.803 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:52.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:52.888 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:52.888 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:52.945 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:52.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:52.945 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:52.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:53.462 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:53.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:53.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:53.571 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:53.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:53.658 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:53.658 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:53.715 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:53.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:53.716 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:53.716 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:53.946 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:53.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:53.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:54.055 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:54.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:54.129 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:54.129 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:54.187 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:54.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:54.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:54.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:54.717 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:54.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:54.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:54.825 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:54.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:54.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:54.905 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:54.962 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:54.963 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:54.963 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:54.963 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:55.189 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:55.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:55.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:55.299 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:55.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:55.385 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:55.385 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:55.442 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:55.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:55.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:55.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:55.964 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:55.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:55.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:56.072 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:56.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:56.151 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:56.151 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:56.208 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:56.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:56.209 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:56.209 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:56.444 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:56.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:56.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:56.553 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:56.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:56.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:56.628 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:56.685 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:56.686 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:56.686 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:56.686 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:57.210 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:57.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:57.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:57.318 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:57.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:57.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:57.396 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:57.453 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:57.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:57.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:57.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:57.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:57.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:57.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:57.795 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:57.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:57.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:57.870 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:57.927 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:57.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:57.928 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:57.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:58.454 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:58.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:58.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:58.561 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:58.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:58.637 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:58.637 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:58.693 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:58.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:58.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:58.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:58.929 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:31:58.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:58.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:59.038 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:31:59.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:31:59.114 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:59.114 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:31:59.171 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:59.171 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:59.171 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:59.171 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:31:59.695 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:31:59.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:59.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:31:59.804 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:31:59.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:31:59.890 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:31:59.890 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:31:59.947 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:31:59.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:31:59.948 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:31:59.948 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:00.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:00.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:00.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:00.285 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:00.369 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:00.369 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:00.369 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:00.427 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:00.427 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:00.427 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:00.427 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:00.949 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:00.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:00.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:01.059 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:01.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:01.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:01.134 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:01.190 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:01.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:01.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:01.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:01.429 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:01.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:01.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:01.538 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:01.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:01.610 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:01.610 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:01.667 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:01.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:01.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:01.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:02.191 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:02.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:02.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:02.298 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:02.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:02.375 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:02.375 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:02.432 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:02.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:02.433 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:02.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:02.669 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:02.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:02.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:02.779 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:02.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:02.855 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:02.855 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:02.912 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:02.913 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:02.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:02.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:03.434 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:03.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:03.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:03.541 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:03.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:03.620 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:03.620 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:03.677 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:03.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:03.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:03.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:03.914 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:03.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:03.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:04.022 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:04.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:04.108 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:04.108 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:04.166 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:04.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:04.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:04.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:04.678 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:04.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:04.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:04.790 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:04.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:04.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:04.873 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:04.930 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:04.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:04.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:04.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:05.167 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:05.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:05.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:05.277 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:05.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:05.364 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:05.364 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:05.421 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:05.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:05.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:05.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:05.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:05.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:05.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:06.039 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:06.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:06.116 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:06.116 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:06.172 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:06.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:06.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:06.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:06.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:06.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:06.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:06.543 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:06.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:06.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:06.616 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:06.673 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:06.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:06.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:06.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:07.174 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:07.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:07.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:07.284 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:07.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:07.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:07.358 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:07.415 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:07.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:07.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:07.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:07.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:07.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:07.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:07.784 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:07.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:07.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:07.860 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:07.917 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:07.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:07.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:07.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:08.418 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:08.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:08.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:08.527 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:08.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:08.611 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:08.611 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:08.669 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:08.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:08.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:08.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:08.919 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:08.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:08.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:09.028 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:09.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:09.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:09.104 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:09.161 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:09.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:09.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:09.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:09.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:09.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:09.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:09.779 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:09.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:09.859 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:09.859 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:09.917 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:09.917 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:09.917 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:09.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:10.162 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:10.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:10.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:10.270 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:10.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:10.345 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:10.345 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:10.402 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:10.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:10.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:10.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:10.919 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:10.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:10.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:11.026 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:11.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:11.102 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:11.102 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:11.159 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:11.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:11.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:11.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:11.404 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:11.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:11.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:11.514 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:11.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:11.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:11.586 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:11.643 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:11.643 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:11.643 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:11.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:12.160 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:12.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:12.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:12.255 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:12.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:12.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:12.346 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:12.404 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:12.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:12.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:12.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:12.645 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:12.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:12.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:12.752 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:12.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:12.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:12.832 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:12.890 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:12.890 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:12.890 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:12.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:13.406 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:13.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:13.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:13.514 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:13.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:13.589 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:13.589 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:13.646 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:13.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:13.647 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:13.647 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:13.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:13.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:13.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:14.001 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:14.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:14.078 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:14.078 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:14.135 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:14.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:14.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:14.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:14.648 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:14.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:14.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:14.757 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:14.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:14.845 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:14.845 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:14.901 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:14.901 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:14.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:14.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:15.138 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:15.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:15.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:15.248 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:15.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:15.323 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:15.323 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:15.380 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:15.381 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:15.381 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:15.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:15.902 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:15.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:15.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:16.013 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:16.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:16.097 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:16.097 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:16.154 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:16.155 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:16.155 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:16.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:16.383 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:16.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:16.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:16.493 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:16.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:16.567 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:16.567 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:16.624 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:16.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:16.625 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:16.625 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:17.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:17.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:17.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:17.264 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:17.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:17.351 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:17.351 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:17.408 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:17.409 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:17.409 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:17.409 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:17.626 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:17.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:17.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:17.734 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:17.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:17.818 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:17.818 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:17.875 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:17.876 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:17.876 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:17.876 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:18.411 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:18.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:18.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:18.519 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:18.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:18.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:18.601 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:18.658 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:18.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:18.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:18.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:18.877 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:18.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:18.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:18.987 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:19.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:19.072 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:19.072 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:19.129 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:19.129 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:19.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:19.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:19.660 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:19.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:19.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:19.768 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:19.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:19.846 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:19.846 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:19.902 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:19.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:19.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:19.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:20.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:20.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:20.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:20.241 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:20.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:20.317 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:20.317 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:20.375 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:20.375 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:20.375 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:20.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:20.904 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:20.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:20.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:21.012 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:21.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:21.098 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:21.099 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:21.156 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:21.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:21.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:21.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:21.377 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:21.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:21.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:21.486 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:21.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:21.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:21.578 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:21.636 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:21.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:21.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:21.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:22.159 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:22.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:22.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:22.267 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:22.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:22.343 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:22.343 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:22.400 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:22.400 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:22.400 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:22.400 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:22.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:22.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:22.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:22.749 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:22.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:22.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:22.832 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:22.889 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:22.889 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:22.889 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:22.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:23.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:23.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:23.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:23.508 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:23.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:23.588 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:23.589 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:23.646 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:23.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:23.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:23.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:23.891 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:23.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:23.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:24.000 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:24.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:24.081 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:24.081 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:24.138 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:24.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:24.139 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:24.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:24.648 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:24.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:24.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:24.755 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:24.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:24.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:24.836 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:24.894 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:24.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:24.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:24.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:25.140 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:25.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:25.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:25.249 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:25.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:25.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:25.331 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:25.387 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:25.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:25.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:25.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:25.896 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:25.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:25.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:26.003 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:26.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:26.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:26.078 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:26.135 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:26.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:26.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:26.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:26.390 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:26.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:26.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:26.498 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:26.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:26.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:26.579 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:26.635 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:26.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:26.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:26.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:27.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:27.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:27.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:27.244 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:27.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:27.325 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:27.326 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:27.383 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:27.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:27.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:27.384 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:27.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:27.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:27.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:27.746 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:27.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:27.826 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:27.826 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:27.883 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:27.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:27.884 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:27.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:28.384 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:28.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:28.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:28.492 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:28.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:28.576 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:28.576 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:28.633 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:28.634 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:28.634 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:28.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:28.885 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:28.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:28.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:28.946 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:29.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:29.021 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:29.021 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:29.079 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:29.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:29.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:29.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:29.635 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:29.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:29.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:29.742 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:29.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:29.825 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:29.825 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:29.883 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:29.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:29.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:29.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:30.081 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:30.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:30.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:30.190 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:30.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:30.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:30.270 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:30.327 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:30.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:30.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:30.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:30.884 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:30.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:30.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:30.992 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:31.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:31.067 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:31.067 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:31.125 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:31.125 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:31.125 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:31.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:31.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:31.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:31.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:31.437 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:31.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:31.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:31.512 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:31.569 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:31.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:31.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:31.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:32.127 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:32.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:32.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:32.235 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:32.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:32.313 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:32.313 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:32.370 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:32.370 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:32.370 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:32.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:32.570 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:32.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:32.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:32.679 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:32.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:32.751 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:32.751 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:32.808 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:32.808 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:32.809 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:32.809 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:33.372 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:33.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:33.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:33.480 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:33.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:33.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:33.563 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:33.620 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:33.620 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:33.620 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:33.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:33.810 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:33.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:33.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:33.919 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:33.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:33.996 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:33.997 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:34.054 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:34.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:34.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:34.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:34.621 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:34.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:34.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:34.729 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:34.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:34.811 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:34.811 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:34.868 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:34.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:34.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:34.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:35.056 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:35.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:35.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:35.164 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:35.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:35.238 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:35.239 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:35.296 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:35.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:35.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:35.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:35.869 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:35.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:35.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:35.976 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:36.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:36.064 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:36.065 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:36.121 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:36.121 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:36.121 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:36.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:36.298 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:36.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:36.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:36.407 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:36.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:36.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:36.487 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:36.545 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:36.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:36.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:36.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:37.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:37.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:37.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:37.230 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:37.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:37.308 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:37.308 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:37.364 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:37.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:37.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:37.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:37.547 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:37.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:37.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:37.658 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:37.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:37.736 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:37.736 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:37.793 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:37.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:37.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:37.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:38.366 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:38.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:38.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:38.473 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:38.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:38.555 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:38.555 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:38.612 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:38.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:38.613 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:38.613 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:38.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:38.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:38.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:38.911 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:38.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:38.992 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:38.992 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:39.049 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:39.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:39.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:39.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:39.614 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:39.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:39.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:39.722 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:39.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:39.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:39.802 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:39.860 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:39.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:39.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:39.861 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:40.051 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:40.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:40.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:40.162 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:40.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:40.252 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:40.252 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:40.309 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:40.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:40.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:40.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:40.862 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:40.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:40.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:40.970 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:41.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:41.048 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:41.048 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:41.106 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:41.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:41.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:41.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:41.311 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:41.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:41.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:41.421 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:41.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:41.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:41.499 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:41.556 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:41.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:41.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:41.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:42.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:42.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:42.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:42.218 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:42.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:42.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:42.295 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:42.351 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:42.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:42.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:42.352 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:42.557 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:42.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:42.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:42.666 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:42.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:42.741 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:42.741 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:42.798 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:42.798 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:42.798 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:42.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:43.353 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:43.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:43.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:43.476 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:43.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:43.557 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:43.557 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:43.615 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:43.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:43.615 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:43.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:43.800 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:43.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:43.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:43.909 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:43.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:43.992 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:43.992 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:44.049 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:44.049 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:44.049 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:44.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:44.617 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:44.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:44.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:44.724 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:44.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:44.807 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:44.807 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:44.864 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:44.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:44.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:44.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:45.051 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:45.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:45.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:45.160 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:45.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:45.242 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:45.242 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:45.300 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:45.300 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:45.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:45.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:45.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:45.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:45.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:45.973 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:46.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:46.045 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:46.045 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:46.102 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:46.102 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:46.102 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:46.102 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:46.302 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:46.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:46.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:46.376 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:46.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:46.446 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:46.447 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:46.504 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:46.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:46.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:46.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:47.104 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:47.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:47.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:47.211 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:47.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:47.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:47.291 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:47.348 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:47.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:47.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:47.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:47.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:47.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:47.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:47.615 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:47.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:47.697 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:47.697 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:47.754 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:47.754 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:47.754 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:47.755 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:48.350 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:48.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:48.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:48.458 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:48.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:48.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:48.536 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:48.593 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:48.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:48.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:48.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:48.756 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:48.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:48.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:48.865 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:48.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:48.938 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:48.938 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:48.996 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:48.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:48.996 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:48.996 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:49.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:49.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:49.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:49.708 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:49.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:49.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:49.797 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:49.854 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:49.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:49.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:49.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:49.997 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:49.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:49.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:50.105 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:50.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:50.177 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:50.178 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:50.234 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:50.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:50.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:50.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:50.856 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:50.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:50.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:50.963 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:51.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:51.039 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:51.040 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:51.097 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:51.097 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:51.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:51.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:51.236 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:51.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:51.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:51.344 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:51.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:51.427 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:51.428 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:51.485 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:51.485 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:51.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:51.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:52.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:52.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:52.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:52.207 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:52.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:52.296 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:52.296 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:52.353 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:52.354 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:52.354 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:52.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:52.487 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:52.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:52.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:52.596 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:52.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:52.679 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:52.679 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:52.736 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:52.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:52.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:52.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:53.355 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:53.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:53.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:53.461 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:53.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:53.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:53.538 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:53.595 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:53.595 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:53.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:53.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:53.738 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:53.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:53.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:53.846 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:53.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:53.926 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:53.926 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:53.984 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:53.984 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:53.984 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:53.985 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:54.597 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:54.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:54.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:54.705 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:54.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:54.781 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:54.781 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:54.838 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:54.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:54.839 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:54.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:54.986 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:54.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:54.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:55.050 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:55.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:55.128 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:55.128 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:55.185 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:55.186 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:55.186 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:55.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:55.840 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:55.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:55.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:55.948 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:56.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:56.040 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:56.040 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:56.098 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:56.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:56.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:56.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:56.188 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:56.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:56.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:56.297 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:56.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:56.380 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:56.381 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:56.438 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:56.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:56.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:56.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:57.100 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:57.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:57.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:57.208 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:57.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:57.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:57.291 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:57.349 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:57.349 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:57.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:57.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:57.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:57.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:57.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:57.512 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:57.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:57.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:57.582 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:57.638 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:57.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:57.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:57.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:58.351 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:58.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:58.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:58.460 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:58.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:58.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:58.550 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:58.608 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:58.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:58.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:58.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:58.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:58.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:58.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:58.747 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:32:58.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:58.836 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:58.836 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:32:58.893 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:58.894 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:58.894 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:58.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:59.610 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:32:59.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:59.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:59.721 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:32:59.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:32:59.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:32:59.797 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:32:59.854 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:32:59.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:32:59.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:32:59.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:32:59.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:32:59.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:32:59.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:32:59.969 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:00.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:00.052 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:00.052 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:00.110 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:00.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:00.111 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:00.111 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:00.856 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:00.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:00.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:00.964 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:01.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:01.039 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:01.039 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:01.096 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:01.096 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:01.096 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:01.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:01.112 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:01.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:01.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:01.219 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:01.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:01.292 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:01.293 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:01.350 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:01.350 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:01.350 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:01.351 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:02.098 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:02.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:02.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:02.205 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:02.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:02.277 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:02.277 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:02.336 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:02.336 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:02.336 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:02.337 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:02.352 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:02.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:02.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:02.459 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:02.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:02.543 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:02.543 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:02.600 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:02.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:02.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:02.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:03.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:03.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:03.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:03.445 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:03.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:03.526 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:03.526 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:03.582 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:03.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:03.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:03.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:03.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:03.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:03.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:03.708 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:03.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:03.797 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:03.797 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:03.854 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:03.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:03.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:03.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:04.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:04.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:04.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:04.691 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:04.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:04.767 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:04.767 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:04.826 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:04.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:04.826 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:04.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:04.855 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:04.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:04.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:04.962 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:05.039 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:05.039 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:05.039 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:05.096 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:05.096 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:05.097 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:05.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:05.828 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:05.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:05.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:05.935 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:06.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:06.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:06.011 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:06.069 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:06.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:06.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:06.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:06.098 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:06.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:06.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:06.204 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:06.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:06.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:06.280 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:06.337 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:06.337 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:06.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:06.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:07.070 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:07.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:07.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:07.177 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:07.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:07.260 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:07.261 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:07.317 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:07.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:07.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:07.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:07.339 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:07.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:07.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:07.445 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:07.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:07.518 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:07.518 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:07.576 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:07.576 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:07.576 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:07.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:08.319 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:08.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:08.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:08.425 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:08.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:08.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:08.508 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:08.566 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:08.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:08.566 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:08.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:08.577 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:08.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:08.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:08.683 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:08.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:08.774 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:08.774 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:08.832 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:08.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:08.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:08.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:09.568 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:09.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:09.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:09.675 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:09.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:09.756 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:09.756 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:09.813 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:09.813 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:09.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:09.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:09.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:09.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:09.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:09.940 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:10.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:10.027 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:10.027 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:10.084 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:10.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:10.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:10.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:10.814 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:10.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:10.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:10.922 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:11.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:11.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:11.010 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:11.068 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:11.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:11.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:11.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:11.086 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:11.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:11.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:11.192 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:11.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:11.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:11.273 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:11.330 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:11.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:11.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:11.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:12.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:12.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:12.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:12.187 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:12.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:12.257 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:12.257 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:12.314 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:12.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:12.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:12.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:12.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:12.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:12.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:12.438 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:12.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:12.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:12.513 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:12.569 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:12.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:12.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:12.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:13.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:13.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:13.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:13.423 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:13.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:13.500 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:13.501 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:13.557 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:13.557 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:13.558 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:13.558 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:13.571 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:13.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:13.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:13.647 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:13.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:13.730 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:13.730 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:13.786 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:13.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:13.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:13.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:14.559 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:14.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:14.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:14.668 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:14.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:14.756 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:14.756 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:14.788 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:14.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:14.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:14.885 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:14.885 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:14.885 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:14.885 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:14.896 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:14.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:14.979 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:14.979 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:15.039 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:15.040 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:15.040 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:15.040 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:15.886 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:15.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:15.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:15.997 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:16.041 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:16.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:16.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:16.118 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:16.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:16.126 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:16.126 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:16.183 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:16.183 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:16.183 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:16.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:16.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:16.200 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:16.200 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:16.257 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:16.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:16.258 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:16.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:17.184 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:17.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:17.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:17.285 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:17.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:17.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:17.339 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:17.349 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:17.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:17.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:17.356 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:17.413 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:17.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:17.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:17.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:17.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:17.433 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:17.433 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:17.491 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:17.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:17.492 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:17.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:18.415 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:18.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:18.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:18.512 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:18.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:18.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:18.565 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:18.575 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:18.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:18.582 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:18.583 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:18.640 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:18.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:18.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:18.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:18.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:18.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:18.654 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:18.710 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:18.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:18.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:18.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:19.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:19.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:19.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:19.741 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:19.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:19.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:19.804 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:19.816 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:19.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:19.823 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:19.823 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:19.879 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:19.879 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:19.879 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:19.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:19.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:19.891 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:19.892 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:19.949 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:19.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:19.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:19.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:20.880 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:20.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:20.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:20.980 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:20.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:20.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:21.033 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:21.043 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:21.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:21.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:21.050 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:21.107 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:21.107 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:21.107 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:21.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:21.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:21.126 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:21.126 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:21.182 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:21.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:21.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:21.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:22.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:22.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:22.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:22.172 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:22.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:22.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:22.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:22.252 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:22.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:22.261 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:22.261 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:22.317 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:22.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:22.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:22.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:22.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:22.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:22.330 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:22.388 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:22.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:22.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:22.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:23.318 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:23.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:23.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:23.418 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:23.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:23.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:23.471 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:23.481 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:23.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:23.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:23.489 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:23.545 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:23.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:23.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:23.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:23.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:23.561 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:23.561 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:23.618 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:23.619 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:23.619 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:23.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:24.547 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:24.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:24.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:24.615 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:24.620 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:24.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:24.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:24.696 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:24.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:24.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:24.704 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:24.760 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:24.760 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:24.760 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:24.760 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:24.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:24.778 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:24.778 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:24.835 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:24.835 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:24.835 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:24.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:25.761 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:25.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:25.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:25.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:25.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:25.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:25.913 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:25.924 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:25.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:25.931 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:25.931 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:25.987 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:25.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:25.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:25.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:26.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:26.004 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:26.004 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:26.062 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:26.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:26.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:26.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:26.988 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:26.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:26.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:27.087 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:27.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:27.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:27.140 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:27.150 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:27.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:27.157 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:27.157 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:27.214 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:27.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:27.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:27.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:27.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:27.236 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:27.236 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:27.295 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:27.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:27.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:27.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:28.215 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:28.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:28.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:28.316 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:28.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:28.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:28.368 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:28.378 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:28.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:28.386 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:28.386 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:28.442 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:28.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:28.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:28.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:28.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:28.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:28.458 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:28.516 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:28.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:28.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:28.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:29.444 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:29.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:29.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:29.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:29.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:29.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:29.524 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:29.580 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:29.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:29.598 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:29.598 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:29.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:29.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:29.654 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:29.656 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:29.656 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:29.656 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:29.656 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:29.711 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:29.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:29.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:29.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:30.657 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:30.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:30.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:30.756 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:30.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:30.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:30.765 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:30.819 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:30.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:30.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:30.847 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:30.904 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:30.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:30.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:30.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:30.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:30.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:30.908 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:30.966 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:30.966 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:30.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:30.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:31.906 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:31.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:31.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:32.005 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:32.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:32.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:32.057 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:32.068 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:32.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:32.074 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:32.074 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:32.131 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:32.132 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:32.132 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:32.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:32.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:32.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:32.156 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:32.213 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:32.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:32.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:32.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:33.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:33.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:33.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:33.231 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:33.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:33.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:33.283 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:33.293 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:33.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:33.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:33.300 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:33.357 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:33.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:33.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:33.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:33.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:33.376 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:33.376 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:33.433 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:33.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:33.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:33.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:34.359 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:34.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:34.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:34.446 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:34.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:34.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:34.497 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:34.508 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:34.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:34.515 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:34.515 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:34.571 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:34.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:34.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:34.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:34.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:34.583 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:34.583 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:34.640 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:34.640 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:34.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:34.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:35.572 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:35.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:35.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:35.670 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:35.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:35.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:35.722 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:35.733 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:35.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:35.740 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:35.740 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:35.796 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:35.796 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:35.796 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:35.796 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:35.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:35.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:35.806 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:35.863 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:35.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:35.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:35.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:36.797 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:36.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:36.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:36.895 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:36.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:36.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:36.947 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:36.958 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:36.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:36.965 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:36.965 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:37.021 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:37.021 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:37.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:37.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:37.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:37.031 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:37.031 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:37.089 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:37.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:37.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:37.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:38.022 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:38.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:38.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:38.121 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:38.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:38.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:38.173 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:38.183 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:38.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:38.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:38.190 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:38.246 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:38.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:38.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:38.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:38.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:38.255 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:38.255 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:38.313 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:38.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:38.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:38.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:39.247 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:39.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:39.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:39.345 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:39.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:39.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:39.398 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:39.408 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:39.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:39.415 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:39.415 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:39.472 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:39.472 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:39.472 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:39.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:39.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:39.481 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:39.482 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:39.539 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:39.539 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:39.539 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:39.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:40.474 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:40.474 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:40.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:40.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:40.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:40.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:40.624 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:40.634 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:40.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:40.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:40.642 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:40.698 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:40.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:40.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:40.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:40.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:40.709 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:40.710 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:40.767 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:40.767 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:40.768 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:40.768 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:41.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:41.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:41.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:41.798 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:41.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:41.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:41.851 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:41.861 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:41.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:41.868 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:41.869 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:41.925 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:41.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:41.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:41.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:41.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:41.933 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:41.933 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:41.992 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:41.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:41.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:41.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:42.926 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:42.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:42.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:43.025 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:43.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:43.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:43.077 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:43.088 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:43.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:43.095 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:43.095 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:43.151 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:43.152 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:43.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:43.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:43.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:43.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:43.163 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:43.222 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:43.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:43.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:43.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:44.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:44.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:44.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:44.251 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:44.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:44.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:44.303 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:44.314 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:44.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:44.322 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:44.322 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:44.379 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:44.380 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:44.380 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:44.380 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:44.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:44.399 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:44.399 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:44.457 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:44.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:44.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:44.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:45.380 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:45.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:45.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:45.478 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:45.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:45.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:45.530 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:45.540 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:45.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:45.547 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:45.547 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:45.605 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:45.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:45.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:45.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:45.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:45.624 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:45.624 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:45.680 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:45.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:45.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:45.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:46.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:46.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:46.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:46.704 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:46.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:46.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:46.756 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:46.766 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:46.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:46.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:46.773 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:46.831 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:46.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:46.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:46.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:46.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:46.849 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:46.850 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:46.907 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:46.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:46.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:46.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:47.832 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:47.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:47.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:47.930 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:47.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:47.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:47.982 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:47.992 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:47.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:47.999 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:47.999 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:48.057 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:48.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:48.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:48.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:48.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:48.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:48.069 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:48.126 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:48.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:48.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:48.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:49.058 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:49.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:49.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:49.157 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:49.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:49.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:49.209 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:49.220 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:49.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:49.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:49.227 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:49.285 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:49.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:49.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:49.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:49.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:49.296 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:49.296 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:49.353 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:49.353 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:49.353 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:49.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:50.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:50.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:50.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:50.385 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:50.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:50.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:50.438 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:50.448 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:50.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:50.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:50.456 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:50.512 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:50.513 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:50.513 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:50.513 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:50.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:50.526 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:50.526 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:50.583 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:50.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:50.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:50.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:51.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:51.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:51.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:51.613 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:51.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:51.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:51.670 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:51.680 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:51.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:51.728 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:51.728 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:51.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:51.769 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:51.769 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:51.785 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:51.786 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:51.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:51.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:51.827 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:51.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:51.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:51.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:52.787 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:52.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:52.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:52.886 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:52.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:52.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:52.938 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:52.948 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:52.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:52.955 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:52.955 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:53.012 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:53.012 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:53.012 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:53.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:53.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:53.033 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:53.033 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:53.091 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:53.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:53.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:53.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:54.014 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:54.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:54.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:54.112 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:54.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:54.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:54.164 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:54.174 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:54.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:54.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:54.182 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:54.239 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:54.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:54.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:54.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:54.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:54.250 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:54.250 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:54.307 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:54.307 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:54.307 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:54.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:55.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:55.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:55.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:55.349 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:55.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:55.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:55.400 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:55.411 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:55.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:55.417 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:55.417 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:55.474 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:55.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:55.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:55.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:55.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:55.494 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:55.494 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:55.553 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:55.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:55.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:55.554 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:56.475 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:56.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:56.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:56.547 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:56.555 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:56.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:56.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:56.622 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:56.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:56.628 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:56.628 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:56.684 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:56.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:56.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:56.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:56.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:56.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:56.706 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:56.763 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:56.763 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:56.763 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:56.763 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:57.685 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:57.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:57.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:57.763 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:57.764 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:57.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:57.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:57.833 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:57.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:57.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:57.851 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:57.908 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:57.908 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:57.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:57.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:57.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:57.910 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:57.910 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:57.967 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:57.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:57.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:57.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:58.910 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:33:58.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:58.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:59.009 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:33:59.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:59.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:33:59.060 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:33:59.070 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:33:59.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:33:59.077 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:59.077 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:33:59.134 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:59.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:59.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:59.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:33:59.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:33:59.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:33:59.154 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:33:59.212 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:33:59.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:33:59.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:33:59.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:00.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:00.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:00.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:00.195 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:00.213 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:00.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:00.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:00.274 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:00.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:00.281 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:00.281 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:00.338 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:00.338 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:00.338 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:00.338 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:00.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:00.362 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:00.362 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:00.418 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:00.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:00.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:00.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:01.339 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:01.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:01.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:01.398 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:01.419 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:01.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:01.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:01.479 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:01.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:01.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:01.489 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:01.545 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:01.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:01.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:01.545 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:01.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:01.558 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:01.558 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:01.616 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:01.616 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:01.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:01.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:02.546 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:02.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:02.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:02.644 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:02.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:02.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:02.697 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:02.707 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:02.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:02.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:02.714 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:02.772 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:02.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:02.772 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:02.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:02.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:02.796 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:02.796 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:02.853 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:02.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:02.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:02.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:03.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:03.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:03.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:03.875 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:03.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:03.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:03.927 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:03.937 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:03.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:03.944 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:03.944 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:04.001 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:04.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:04.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:04.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:04.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:04.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:04.014 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:04.071 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:04.071 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:04.071 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:04.072 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:05.003 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:05.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:05.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:05.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:05.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:05.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:05.154 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:05.164 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:05.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:05.171 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:05.171 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:05.228 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:05.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:05.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:05.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:05.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:05.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:05.247 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:05.305 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:05.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:05.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:05.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:06.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:06.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:06.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:06.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:06.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:06.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:06.380 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:06.391 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:06.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:06.397 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:06.397 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:06.454 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:06.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:06.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:06.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:06.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:06.476 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:06.476 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:06.533 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:06.533 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:06.534 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:06.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:07.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:07.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:07.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:07.555 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:07.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:07.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:07.606 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:07.616 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:07.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:07.623 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:07.623 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:07.680 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:07.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:07.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:07.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:07.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:07.695 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:07.695 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:07.753 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:07.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:07.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:07.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:08.681 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:08.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:08.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:08.779 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:08.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:08.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:08.832 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:08.842 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:08.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:08.850 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:08.850 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:08.906 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:08.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:08.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:08.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:08.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:08.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:08.928 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:08.986 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:08.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:08.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:08.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:09.908 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:09.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:09.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:10.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:10.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:10.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:10.060 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:10.070 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:10.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:10.077 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:10.077 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:10.134 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:10.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:10.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:10.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:10.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:10.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:10.154 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:10.211 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:10.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:10.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:10.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:11.135 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:11.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:11.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:11.235 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:11.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:11.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:11.287 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:11.297 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:11.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:11.304 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:11.304 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:11.362 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:11.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:11.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:11.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:11.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:11.383 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:11.383 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:11.441 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:11.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:11.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:11.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:12.363 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:12.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:12.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:12.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:12.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:12.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:12.518 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:12.530 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:12.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:12.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:12.536 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:12.593 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:12.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:12.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:12.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:12.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:12.604 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:12.604 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:12.661 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:12.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:12.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:12.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:13.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:13.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:13.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:13.694 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:13.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:13.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:13.747 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:13.757 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:13.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:13.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:13.764 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:13.821 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:13.821 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:13.822 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:13.822 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:13.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:13.836 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:13.836 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:13.892 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:13.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:13.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:13.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:14.823 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:14.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:14.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:14.922 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:14.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:14.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:14.975 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:14.985 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:14.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:14.992 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:14.992 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:15.050 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:15.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:15.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:15.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:15.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:15.070 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:15.070 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:15.127 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:15.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:15.128 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:15.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:16.051 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:16.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:16.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:16.151 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:16.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:16.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:16.210 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:16.220 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:16.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:16.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:16.227 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:16.285 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:16.285 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:16.285 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:16.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:16.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:16.298 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:16.298 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:16.356 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:16.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:16.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:16.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:17.287 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:17.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:17.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:17.386 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:17.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:17.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:17.437 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:17.447 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:17.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:17.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:17.496 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:17.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:17.526 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:17.527 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:17.553 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:17.553 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:17.553 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:17.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:17.583 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:17.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:17.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:17.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:18.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:18.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:18.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:18.653 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:18.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:18.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:18.706 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:18.716 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:18.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:18.724 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:18.724 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:18.780 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:18.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:18.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:18.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:18.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:18.791 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:18.791 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:18.848 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:18.848 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:18.848 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:18.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:19.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:19.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:19.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:19.881 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:19.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:19.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:19.934 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:19.944 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:19.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:19.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:19.952 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:20.009 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:20.009 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:20.009 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:20.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:20.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:20.024 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:20.024 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:20.082 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:20.082 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:20.082 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:20.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:21.010 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:21.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:21.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:21.110 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:21.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:21.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:21.163 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:21.174 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:21.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:21.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:21.181 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:21.239 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:21.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:21.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:21.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:21.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:21.256 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:21.256 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:21.312 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:21.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:21.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:21.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:22.240 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:22.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:22.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:22.341 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:22.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:22.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:22.392 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:22.403 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:22.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:22.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:22.410 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:22.468 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:22.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:22.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:22.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:22.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:22.489 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:22.489 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:22.547 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:22.547 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:22.547 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:22.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:23.469 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:23.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:23.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:23.570 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:23.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:23.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:23.623 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:23.633 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:23.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:23.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:23.640 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:23.696 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:23.696 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:23.696 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:23.696 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:23.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:23.720 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:23.720 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:23.778 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:23.778 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:23.778 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:23.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:24.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:24.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:24.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:24.798 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:24.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:24.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:24.851 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:24.862 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:24.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:24.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:24.870 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:24.927 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:24.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:24.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:24.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:24.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:24.936 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:24.936 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:24.994 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:24.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:24.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:24.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:25.928 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:25.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:25.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:26.027 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:26.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:26.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:26.079 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:26.090 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:26.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:26.097 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:26.097 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:26.154 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:26.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:26.154 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:26.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:26.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:26.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:26.163 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:26.221 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:26.221 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:26.221 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:26.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:27.155 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:27.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:27.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:27.253 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:27.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:27.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:27.305 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:27.315 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:27.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:27.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:27.323 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:27.379 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:27.379 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:27.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:27.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:27.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:27.393 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:27.393 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:27.451 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:27.451 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:27.452 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:27.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:28.380 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:28.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:28.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:28.479 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:28.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:28.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:28.531 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:28.541 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:28.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:28.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:28.548 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:28.605 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:28.605 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:28.605 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:28.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:28.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:28.624 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:28.624 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:28.681 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:28.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:28.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:28.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:29.607 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:29.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:29.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:29.704 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:29.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:29.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:29.756 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:29.767 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:29.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:29.774 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:29.774 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:29.832 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:29.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:29.832 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:29.832 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:29.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:29.855 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:29.855 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:29.911 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:29.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:29.912 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:29.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:30.833 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:30.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:30.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:30.932 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:30.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:30.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:30.984 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:30.995 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:31.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:31.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:31.002 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:31.059 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:31.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:31.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:31.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:31.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:31.077 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:31.078 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:31.134 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:31.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:31.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:31.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:32.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:32.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:32.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:32.159 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:32.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:32.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:32.211 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:32.221 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:32.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:32.228 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:32.228 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:32.285 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:32.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:32.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:32.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:32.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:32.304 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:32.304 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:32.362 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:32.362 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:32.362 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:32.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:33.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:33.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:33.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:33.387 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:33.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:33.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:33.438 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:33.449 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:33.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:33.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:33.456 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:33.513 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:33.514 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:33.514 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:33.514 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:33.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:33.528 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:33.528 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:33.585 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:33.585 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:33.585 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:33.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:34.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:34.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:34.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:34.614 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:34.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:34.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:34.666 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:34.677 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:34.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:34.684 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:34.684 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:34.740 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:34.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:34.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:34.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:34.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:34.759 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:34.759 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:34.816 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:34.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:34.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:34.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:35.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:35.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:35.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:35.841 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:35.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:35.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:35.894 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:35.905 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:35.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:35.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:35.911 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:35.969 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:35.969 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:35.969 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:35.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:35.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:35.989 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:35.989 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:36.046 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:36.046 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:36.046 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:36.047 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:36.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:36.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:36.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:37.072 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:37.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:37.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:37.124 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:37.135 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:37.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:37.142 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:37.142 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:37.198 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:37.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:37.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:37.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:37.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:37.211 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:37.211 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:37.269 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:37.269 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:37.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:37.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:38.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:38.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:38.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:38.263 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:38.271 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:38.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:38.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:38.332 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:38.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:38.340 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:38.340 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:38.397 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:38.398 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:38.398 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:38.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:38.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:38.418 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:38.418 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:38.476 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:38.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:38.476 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:38.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:39.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:39.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:39.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:39.499 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:39.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:39.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:39.552 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:39.562 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:39.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:39.569 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:39.569 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:39.627 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:39.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:39.627 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:39.627 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:39.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:39.652 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:39.652 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:39.710 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:39.710 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:39.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:39.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:40.628 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:40.629 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:40.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:40.727 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:40.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:40.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:40.779 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:40.790 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:40.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:40.797 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:40.797 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:40.853 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:40.853 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:40.853 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:40.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:40.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:40.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:40.872 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:40.929 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:40.930 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:40.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:40.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:41.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:41.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:41.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:41.931 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:41.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:41.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:41.936 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:41.994 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:42.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:42.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:42.011 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:42.069 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:42.069 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:42.069 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:42.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:42.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:42.071 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:42.072 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:42.128 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:42.128 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:42.129 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:42.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:43.070 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:43.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:43.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:43.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:43.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:43.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:43.221 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:43.231 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:43.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:43.239 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:43.239 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:43.295 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:43.295 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:43.295 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:43.296 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:43.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:43.308 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:43.309 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:43.366 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:43.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:43.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:43.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:44.296 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:44.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:44.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:44.395 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:44.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:44.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:44.448 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:44.458 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:44.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:44.465 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:44.465 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:44.521 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:44.522 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:44.522 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:44.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:44.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:44.537 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:44.537 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:44.595 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:44.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:44.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:44.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:45.523 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:45.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:45.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:45.622 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:45.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:45.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:45.675 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:45.686 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:45.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:45.692 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:45.692 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:45.750 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:45.750 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:45.750 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:45.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:45.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:45.775 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:45.775 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:45.833 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:45.833 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:45.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:45.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:46.751 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:34:46.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:46.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:46.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:34:46.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:46.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial109.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:34:46.861 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-12T22:34:46.914 DEBUG:teuthology.orchestra.run.trial109:> true 2026-02-12T22:34:46.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-12T22:34:46.931 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:46.931 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-12T22:34:46.987 INFO:teuthology.orchestra.run.trial104.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:46.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:46.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:46.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:46.987 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:46.989 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:34:47.000 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:34:47.030 INFO:teuthology.run:Summary data: description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress traceless/50pc} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:34:47.031 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:34:47.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial109.front.sepia.ceph.com' 2026-02-12T22:34:47.036 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:34:47.036 DEBUG:teuthology.orchestra.run.trial109:> uname -r 2026-02-12T22:34:47.126 INFO:teuthology.orchestra.run.trial109.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:34:47.126 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:34:47.126 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:34:47.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:34:47.143 INFO:teuthology.run:FAIL