2026-02-12T22:01:02.280 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:01:02.298 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:01:02.381 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47107 branch: wip-pdonnell-testing-20260210.171210 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47107' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: fs: - name: a - name: b session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 fuse set user groups: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - Replacing daemon mds sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: cephfs_name: a client.1: cephfs_name: b selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJfjrnRBFQIklnIbM+JMJh8ujLYVdU5Flkj0ZC+vCHbVYLwinU3kbY4us4BEphifR3NsS8pRY/iXY5aO2TCY9k= trial126.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAUVTOZJkkALj/VshQs84pqgCXPOOdHc6T98Sdov5L2SUEI01UOg/Wa9ukXBcE1c+SD1fCSaZ54mreEPFxOtJjU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - ceph-fuse: null - mds_thrash: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:01:02.382 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:01:02.382 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:01:02.382 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:01:02.383 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:01:02.384 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:01:02.384 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:01:02.384 INFO:teuthology.packaging:ref: None 2026-02-12T22:01:02.384 INFO:teuthology.packaging:tag: None 2026-02-12T22:01:02.384 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:01:02.384 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:01:02.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:01:02.497 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:01:02.499 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:01:02.510 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:01:02.510 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:01:02.524 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:01:02.541 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:01:02.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:01:02.625 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial092.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47107', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 21:57:42.831624', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJfjrnRBFQIklnIbM+JMJh8ujLYVdU5Flkj0ZC+vCHbVYLwinU3kbY4us4BEphifR3NsS8pRY/iXY5aO2TCY9k='} 2026-02-12T22:01:02.681 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial126.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47107', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 21:57:42.832249', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAUVTOZJkkALj/VshQs84pqgCXPOOdHc6T98Sdov5L2SUEI01UOg/Wa9ukXBcE1c+SD1fCSaZ54mreEPFxOtJjU='} 2026-02-12T22:01:02.681 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:01:02.692 INFO:teuthology.task.internal:roles: ubuntu@trial092.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:01:02.692 INFO:teuthology.task.internal:roles: ubuntu@trial126.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-12T22:01:02.692 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:01:02.824 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x768662dfdf80>, signals=[15]) 2026-02-12T22:01:02.825 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:01:02.838 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:01:02.838 DEBUG:teuthology.task.internal:connecting to ubuntu@trial092.front.sepia.ceph.com 2026-02-12T22:01:02.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:02.898 DEBUG:teuthology.task.internal:connecting to ubuntu@trial126.front.sepia.ceph.com 2026-02-12T22:01:02.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:01:02.957 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:01:02.969 DEBUG:teuthology.orchestra.run.trial092:> uname -m 2026-02-12T22:01:02.986 INFO:teuthology.orchestra.run.trial092.stdout:x86_64 2026-02-12T22:01:02.986 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release 2026-02-12T22:01:03.043 INFO:teuthology.orchestra.run.trial092.stdout:NAME="Rocky Linux" 2026-02-12T22:01:03.043 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:01:03.043 INFO:teuthology.orchestra.run.trial092.stdout:ID="rocky" 2026-02-12T22:01:03.043 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:01:03.043 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="10.1" 2026-02-12T22:01:03.043 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;32" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:VENDOR_NAME="RESF" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:01:03.044 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:03.044 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server 2026-02-12T22:01:03.113 DEBUG:teuthology.orchestra.run.trial126:> uname -m 2026-02-12T22:01:03.130 INFO:teuthology.orchestra.run.trial126.stdout:x86_64 2026-02-12T22:01:03.130 DEBUG:teuthology.orchestra.run.trial126:> cat /etc/os-release 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:NAME="Rocky Linux" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:ID="rocky" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:VERSION_ID="10.1" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:ANSI_COLOR="0;32" 2026-02-12T22:01:03.188 INFO:teuthology.orchestra.run.trial126.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:VENDOR_NAME="RESF" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:01:03.189 INFO:teuthology.orchestra.run.trial126.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:01:03.189 INFO:teuthology.lock.ops:Updating trial126.front.sepia.ceph.com on lock server 2026-02-12T22:01:03.264 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:01:03.276 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:01:03.287 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:01:03.287 DEBUG:teuthology.orchestra.run.trial092:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:01:03.289 DEBUG:teuthology.orchestra.run.trial126:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:01:03.305 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:01:03.316 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:01:03.316 DEBUG:teuthology.orchestra.run.trial092:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:01:03.346 DEBUG:teuthology.orchestra.run.trial126:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:01:03.361 INFO:teuthology.orchestra.run.trial092.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:01:03.363 INFO:teuthology.orchestra.run.trial126.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:01:03.364 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:01:03.518 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:01:03.537 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:01:03.537 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:01:03.537 DEBUG:teuthology.orchestra.run.trial092:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:01:03.537 DEBUG:teuthology.orchestra.run.trial126:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:01:03.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:01:03.553 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:01:03.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:01:03.554 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:01:03.610 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:03.610 INFO:teuthology.task.kernel:Running kernel on trial092: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:03.610 DEBUG:teuthology.orchestra.run.trial092:> sudo yum install -y kernel 2026-02-12T22:01:03.610 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:03.611 INFO:teuthology.task.kernel:Running kernel on trial126: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:01:03.611 DEBUG:teuthology.orchestra.run.trial126:> sudo yum install -y kernel 2026-02-12T22:01:04.155 INFO:teuthology.orchestra.run.trial126.stdout:Rocky Linux 10 - AppStream 15 MB/s | 2.2 MB 00:00 2026-02-12T22:01:04.167 INFO:teuthology.orchestra.run.trial092.stdout:Rocky Linux 10 - AppStream 14 MB/s | 2.2 MB 00:00 2026-02-12T22:01:04.495 INFO:teuthology.orchestra.run.trial092.stdout:Rocky Linux 10 - BaseOS 54 MB/s | 11 MB 00:00 2026-02-12T22:01:04.509 INFO:teuthology.orchestra.run.trial126.stdout:Rocky Linux 10 - BaseOS 48 MB/s | 11 MB 00:00 2026-02-12T22:01:04.992 INFO:teuthology.orchestra.run.trial092.stdout:Rocky Linux 10 - CRB 6.0 MB/s | 503 kB 00:00 2026-02-12T22:01:05.003 INFO:teuthology.orchestra.run.trial126.stdout:Rocky Linux 10 - CRB 6.2 MB/s | 503 kB 00:00 2026-02-12T22:01:05.261 INFO:teuthology.orchestra.run.trial126.stdout:Extra Packages for Enterprise Linux 30 MB/s | 6.2 MB 00:00 2026-02-12T22:01:05.757 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 6.2 MB 00:00 2026-02-12T22:01:05.920 INFO:teuthology.orchestra.run.trial126.stdout:lab-extras 170 kB/s | 3.7 kB 00:00 2026-02-12T22:01:06.334 INFO:teuthology.orchestra.run.trial126.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:01:06.345 INFO:teuthology.orchestra.run.trial126.stdout:Dependencies resolved. 2026-02-12T22:01:06.346 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: Package Arch Version Repo Size 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout:Installing: 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout:Installing dependencies: 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:01:06.347 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout:Transaction Summary 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout:Install 5 Packages 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout:Total download size: 93 M 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout:Installed size: 135 M 2026-02-12T22:01:06.348 INFO:teuthology.orchestra.run.trial126.stdout:Downloading Packages: 2026-02-12T22:01:06.400 INFO:teuthology.orchestra.run.trial126.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-12T22:01:06.412 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 291 kB/s | 3.7 kB 00:00 2026-02-12T22:01:06.618 INFO:teuthology.orchestra.run.trial126.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 68 MB/s | 18 MB 00:00 2026-02-12T22:01:06.675 INFO:teuthology.orchestra.run.trial126.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 50 MB/s | 2.8 MB 00:00 2026-02-12T22:01:06.830 INFO:teuthology.orchestra.run.trial092.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:01:06.842 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-12T22:01:06.843 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-12T22:01:06.843 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-12T22:01:06.843 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-12T22:01:06.843 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-12T22:01:06.843 INFO:teuthology.orchestra.run.trial092.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:01:06.843 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout:Install 5 Packages 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 93 M 2026-02-12T22:01:06.844 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 135 M 2026-02-12T22:01:06.845 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-12T22:01:06.858 INFO:teuthology.orchestra.run.trial126.stdout:(4/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 79 MB/s | 41 MB 00:00 2026-02-12T22:01:06.905 INFO:teuthology.orchestra.run.trial092.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 22 MB/s | 1.4 MB 00:00 2026-02-12T22:01:06.926 INFO:teuthology.orchestra.run.trial126.stdout:(5/5): kernel-modules-core-6.12.0-124.31.1.el10 56 MB/s | 30 MB 00:00 2026-02-12T22:01:06.927 INFO:teuthology.orchestra.run.trial126.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:01:06.927 INFO:teuthology.orchestra.run.trial126.stdout:Total 160 MB/s | 93 MB 00:00 2026-02-12T22:01:06.927 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction check 2026-02-12T22:01:07.071 INFO:teuthology.orchestra.run.trial126.stdout:Transaction check succeeded. 2026-02-12T22:01:07.071 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction test 2026-02-12T22:01:07.172 INFO:teuthology.orchestra.run.trial092.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 56 MB/s | 18 MB 00:00 2026-02-12T22:01:07.226 INFO:teuthology.orchestra.run.trial092.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 52 MB/s | 2.8 MB 00:00 2026-02-12T22:01:07.317 INFO:teuthology.orchestra.run.trial092.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 72 MB/s | 30 MB 00:00 2026-02-12T22:01:07.376 INFO:teuthology.orchestra.run.trial092.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 76 MB/s | 41 MB 00:00 2026-02-12T22:01:07.377 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:01:07.377 INFO:teuthology.orchestra.run.trial092.stdout:Total 174 MB/s | 93 MB 00:00 2026-02-12T22:01:07.377 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-12T22:01:07.472 INFO:teuthology.orchestra.run.trial126.stdout:Transaction test succeeded. 2026-02-12T22:01:07.472 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction 2026-02-12T22:01:07.522 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-12T22:01:07.523 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-12T22:01:07.926 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-12T22:01:07.927 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-12T22:01:08.164 INFO:teuthology.orchestra.run.trial126.stdout: Preparing : 1/1 2026-02-12T22:01:08.365 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:01:08.386 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:08.617 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-12T22:01:08.818 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:01:08.839 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:09.643 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:09.671 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:01:10.090 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:01:10.118 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:01:11.524 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:01:11.529 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:01:11.970 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:01:11.975 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:01:13.394 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:01:13.404 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:13.839 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:01:13.849 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:15.266 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:15.711 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.045 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.068 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.302 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.302 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-12T22:01:49.302 INFO:teuthology.orchestra.run.trial126.stdout:Installed: 2026-02-12T22:01:49.302 INFO:teuthology.orchestra.run.trial126.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.302 INFO:teuthology.orchestra.run.trial126.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.303 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.303 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.303 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.303 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-12T22:01:49.303 INFO:teuthology.orchestra.run.trial126.stdout:Complete! 2026-02-12T22:01:49.366 DEBUG:teuthology.orchestra.run.trial126:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:01:49.399 INFO:teuthology.orchestra.run.trial126.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.400 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.400 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.400 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:01:49.400 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:01:49.401 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:01:49.401 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial126.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:01:49.401 DEBUG:teuthology.orchestra.run.trial126:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:01:49.418 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.442 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.473 INFO:teuthology.orchestra.run.trial126.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.475 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.475 DEBUG:teuthology.orchestra.run.trial126:> sudo rpm -qi grub2-tools 2026-02-12T22:01:49.546 INFO:teuthology.orchestra.run.trial126.stdout:Name : grub2-tools 2026-02-12T22:01:49.546 INFO:teuthology.orchestra.run.trial126.stdout:Epoch : 1 2026-02-12T22:01:49.546 INFO:teuthology.orchestra.run.trial126.stdout:Version : 2.12 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Release : 29.el10_1 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Architecture: x86_64 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Group : Unspecified 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Size : 7963769 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:License : GPL-3.0-or-later 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Signature : 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:01:49.547 INFO:teuthology.orchestra.run.trial126.stdout:Packager : Release Engineering 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:Summary : Support tools for GRUB. 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:Description : 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:hardware devices. 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-12T22:01:49.548 INFO:teuthology.orchestra.run.trial126.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:01:49.549 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:01:49.550 INFO:teuthology.task.kernel:Updating grub on trial126 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.550 DEBUG:teuthology.orchestra.run.trial126:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:01:49.616 INFO:teuthology.orchestra.run.trial126.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:01:49.617 DEBUG:teuthology.orchestra.run.trial126:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:01:49.678 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:01:49.678 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-12T22:01:49.678 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-12T22:01:49.679 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-12T22:01:49.685 INFO:teuthology.orchestra.run.trial126.stdout:/sbin/grubby 2026-02-12T22:01:49.686 INFO:teuthology.orchestra.run.trial126.stdout:yes 2026-02-12T22:01:49.687 DEBUG:teuthology.orchestra.run.trial126:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:01:49.741 DEBUG:teuthology.orchestra.run.trial092:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:01:49.753 INFO:teuthology.orchestra.run.trial126.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:01:49.754 DEBUG:teuthology.orchestra.run.trial126:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.776 INFO:teuthology.orchestra.run.trial092.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.776 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.776 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.776 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:01:49.776 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:01:49.776 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:01:49.777 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial092.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:01:49.777 DEBUG:teuthology.orchestra.run.trial092:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:01:49.830 DEBUG:teuthology.orchestra.run.trial126:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:01:49.849 INFO:teuthology.orchestra.run.trial092.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.850 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.850 DEBUG:teuthology.orchestra.run.trial092:> sudo rpm -qi grub2-tools 2026-02-12T22:01:49.920 INFO:teuthology.orchestra.run.trial092.stdout:Name : grub2-tools 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Epoch : 1 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Version : 2.12 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Release : 29.el10_1 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Architecture: x86_64 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Group : Unspecified 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Size : 7963769 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:License : GPL-3.0-or-later 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Signature : 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Packager : Release Engineering 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Summary : Support tools for GRUB. 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:Description : 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout:hardware devices. 2026-02-12T22:01:49.921 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-12T22:01:49.922 INFO:teuthology.orchestra.run.trial092.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:01:49.922 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:01:49.922 INFO:teuthology.task.kernel:Updating grub on trial092 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:49.922 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:01:49.941 INFO:teuthology.orchestra.run.trial126.stderr:Generating grub configuration file ... 2026-02-12T22:01:49.988 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:01:49.990 DEBUG:teuthology.orchestra.run.trial092:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:01:50.055 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/grubby 2026-02-12T22:01:50.057 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-12T22:01:50.057 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:01:50.118 INFO:teuthology.orchestra.run.trial126.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:01:50.122 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:01:50.123 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:01:50.128 INFO:teuthology.orchestra.run.trial126.stderr:done 2026-02-12T22:01:50.130 DEBUG:teuthology.orchestra.run.trial126:> test -d /sys/firmware/efi 2026-02-12T22:01:50.146 DEBUG:teuthology.orchestra.run.trial126:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:01:50.198 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:01:50.219 INFO:teuthology.orchestra.run.trial126.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:01:50.219 INFO:teuthology.orchestra.run.trial126.stdout:/boot/efi/EFI/rocky 2026-02-12T22:01:50.221 DEBUG:teuthology.orchestra.run.trial126:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:01:50.288 INFO:teuthology.orchestra.run.trial126.stdout:no 2026-02-12T22:01:50.289 DEBUG:teuthology.orchestra.run.trial126:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:01:50.309 INFO:teuthology.orchestra.run.trial092.stderr:Generating grub configuration file ... 2026-02-12T22:01:50.355 INFO:teuthology.orchestra.run.trial126.stdout:yes 2026-02-12T22:01:50.356 DEBUG:teuthology.orchestra.run.trial126:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:01:50.422 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial126 2026-02-12T22:01:50.422 DEBUG:teuthology.orchestra.run.trial126:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:01:50.485 INFO:teuthology.orchestra.run.trial092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:01:50.487 INFO:teuthology.orchestra.run.trial126.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:01:50.494 INFO:teuthology.orchestra.run.trial092.stderr:done 2026-02-12T22:01:50.496 DEBUG:teuthology.orchestra.run.trial092:> test -d /sys/firmware/efi 2026-02-12T22:01:50.514 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:01:50.586 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:01:50.586 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/rocky 2026-02-12T22:01:50.588 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:01:50.655 INFO:teuthology.orchestra.run.trial092.stdout:no 2026-02-12T22:01:50.655 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:01:50.722 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-12T22:01:50.722 DEBUG:teuthology.orchestra.run.trial092:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:01:50.788 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial092 2026-02-12T22:01:50.788 DEBUG:teuthology.orchestra.run.trial092:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:01:50.853 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:02:20.464 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:20.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:20.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:20.576 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:20.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:20.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:20.654 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:20.711 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:20.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:20.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:20.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:20.830 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:20.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:20.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:20.939 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:21.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:21.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:21.019 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:21.077 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:21.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:21.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:21.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:21.715 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:21.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:21.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:21.824 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:21.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:21.901 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:21.901 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:21.959 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:21.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:21.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:21.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:22.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:22.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:22.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:22.187 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:22.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:22.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:22.273 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:22.330 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:22.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:22.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:22.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:22.961 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:22.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:22.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:23.069 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:23.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:23.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:23.156 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:23.212 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:23.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:23.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:23.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:23.332 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:23.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:23.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:23.439 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:23.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:23.514 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:23.514 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:23.571 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:23.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:23.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:23.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:24.215 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:24.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:24.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:24.303 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:24.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:24.393 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:24.393 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:24.450 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:24.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:24.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:24.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:24.574 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:24.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:24.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:24.680 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:24.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:24.761 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:24.761 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:24.818 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:24.818 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:24.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:24.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:25.452 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:25.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:25.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:25.560 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:25.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:25.648 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:25.648 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:25.705 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:25.706 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:25.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:25.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:25.820 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:25.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:25.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:25.927 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:26.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:26.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:26.002 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:26.059 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:26.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:26.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:26.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:26.707 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:26.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:26.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:26.816 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:26.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:26.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:26.900 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:26.958 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:26.958 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:26.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:26.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:27.062 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:27.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:27.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:27.168 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:27.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:27.244 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:27.244 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:27.301 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:27.301 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:27.301 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:27.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:27.960 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:27.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:27.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:28.047 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:28.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:28.125 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:28.125 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:28.182 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:28.182 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:28.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:28.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:28.302 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:28.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:28.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:28.411 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:28.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:28.487 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:28.488 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:28.545 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:28.545 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:28.545 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:28.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:29.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:29.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:29.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:29.293 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:29.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:29.380 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:29.380 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:29.437 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:29.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:29.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:29.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:29.547 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:29.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:29.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:29.655 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:29.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:29.742 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:29.742 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:29.799 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:29.800 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:29.800 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:29.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:30.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:30.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:30.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:30.549 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:30.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:30.632 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:30.632 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:30.690 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:30.690 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:30.690 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:30.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:30.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:30.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:30.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:30.909 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:31.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:31.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:31.000 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:31.057 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:31.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:31.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:31.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:31.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:31.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:31.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:31.801 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:31.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:31.889 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:31.889 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:31.946 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:31.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:31.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:31.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:32.059 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:32.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:32.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:32.167 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:32.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:32.251 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:32.251 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:32.308 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:32.309 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:32.309 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:32.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:32.948 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:32.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:32.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:33.062 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:33.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:33.141 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:33.142 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:33.199 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:33.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:33.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:33.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:33.311 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:33.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:33.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:33.419 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:33.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:33.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:33.493 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:33.550 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:33.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:33.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:33.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:34.202 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:34.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:34.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:34.311 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:34.395 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:34.395 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:34.395 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:34.453 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:34.453 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:34.453 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:34.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:34.553 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:34.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:34.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:34.659 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:34.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:34.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:34.747 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:34.804 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:34.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:34.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:34.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:35.455 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:35.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:35.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:35.564 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:35.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:35.655 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:35.655 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:35.712 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:35.712 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:35.712 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:35.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:35.805 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:35.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:35.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:35.913 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:35.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:35.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:35.997 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:36.054 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:36.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:36.054 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:36.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:36.714 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:36.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:36.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:36.822 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:36.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:36.895 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:36.895 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:36.952 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:36.953 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:36.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:36.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:37.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:37.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:37.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:37.163 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:37.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:37.236 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:37.236 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:37.293 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:37.294 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:37.294 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:37.294 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:37.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:37.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:37.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:38.067 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:38.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:38.139 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:38.140 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:38.196 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:38.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:38.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:38.295 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:38.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:38.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:38.402 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:38.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:38.477 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:38.478 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:38.535 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:38.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:38.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:38.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:39.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:39.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:39.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:39.306 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:39.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:39.384 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:39.385 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:39.441 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:39.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:39.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:39.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:39.537 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:39.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:39.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:39.645 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:39.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:39.771 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:39.771 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:39.828 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:39.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:39.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:39.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:40.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:40.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:40.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:40.553 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:40.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:40.635 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:40.636 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:40.693 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:40.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:40.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:40.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:40.829 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:40.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:40.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:40.938 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:41.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:41.020 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:41.020 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:41.077 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:41.078 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:41.078 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:41.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:41.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:41.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:41.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:41.804 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:41.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:41.891 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:41.891 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:41.949 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:41.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:41.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:41.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:42.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:42.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:42.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:42.185 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:42.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:42.260 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:42.260 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:42.319 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:42.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:42.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:42.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:42.951 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:42.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:42.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:43.060 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:43.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:43.141 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:43.141 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:43.199 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:43.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:43.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:43.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:43.322 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:43.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:43.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:43.430 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:43.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:43.509 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:43.509 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:43.565 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:43.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:43.566 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:43.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:44.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:44.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:44.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:44.309 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:44.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:44.382 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:44.382 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:44.439 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:44.439 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:44.439 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:44.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:44.567 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:44.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:44.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:44.679 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:44.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:44.762 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:44.762 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:44.819 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:44.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:44.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:44.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:45.441 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:45.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:45.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:45.549 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:45.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:45.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:45.627 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:45.685 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:45.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:45.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:45.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:45.820 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:45.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:45.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:45.928 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:46.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:46.012 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:46.012 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:46.069 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:46.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:46.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:46.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:46.687 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:46.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:46.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:46.797 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:46.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:46.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:46.874 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:46.932 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:46.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:46.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:46.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:47.071 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:47.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:47.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:47.179 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:47.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:47.266 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:47.266 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:47.324 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:47.324 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:47.324 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:47.324 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:47.933 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:47.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:47.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:48.040 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:48.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:48.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:48.117 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:48.174 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:48.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:48.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:48.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:48.326 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:48.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:48.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:48.439 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:48.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:48.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:48.520 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:48.577 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:48.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:48.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:48.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:49.176 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:49.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:49.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:49.284 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:49.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:49.365 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:49.366 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:49.423 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:49.423 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:49.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:49.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:49.579 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:49.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:49.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:49.686 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:49.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:49.759 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:49.760 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:49.817 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:49.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:49.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:49.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:50.425 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:50.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:50.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:50.532 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:50.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:50.614 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:50.614 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:50.671 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:50.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:50.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:50.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:50.818 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:50.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:50.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:50.926 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:51.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:51.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:51.002 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:51.059 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:51.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:51.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:51.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:51.673 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:51.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:51.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:51.781 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:51.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:51.868 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:51.868 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:51.925 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:51.926 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:51.926 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:51.926 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:52.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:52.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:52.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:52.172 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:52.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:52.262 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:52.262 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:52.318 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:52.319 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:52.319 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:52.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:52.927 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:52.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:52.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:53.036 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:53.115 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:53.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:53.116 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:53.173 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:53.173 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:53.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:53.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:53.320 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:53.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:53.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:53.420 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:53.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:53.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:53.493 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:53.550 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:53.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:53.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:53.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:54.175 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:54.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:54.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:54.237 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:54.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:54.311 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:54.311 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:54.367 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:54.367 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:54.367 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:54.367 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:54.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:54.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:54.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:54.614 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:54.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:54.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:54.692 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:54.748 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:54.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:54.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:54.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:55.369 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:55.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:55.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:55.430 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:55.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:55.514 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:55.514 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:55.570 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:55.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:55.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:55.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:55.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:55.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:55.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:55.811 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:55.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:55.881 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:55.881 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:55.937 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:55.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:55.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:55.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:56.571 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:56.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:56.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:56.633 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:56.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:56.707 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:56.707 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:56.764 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:56.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:56.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:56.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:56.938 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:56.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:56.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:56.999 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:57.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:57.086 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:57.087 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:57.143 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:57.143 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:57.143 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:57.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:57.765 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:57.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:57.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:57.877 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:57.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:57.958 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:57.958 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:58.016 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:58.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:58.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:58.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:58.144 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:58.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:58.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:58.254 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:58.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:58.338 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:58.338 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:58.396 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:58.396 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:58.396 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:58.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:59.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:02:59.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:59.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:59.127 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:02:59.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:02:59.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:59.202 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:02:59.259 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:59.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:59.260 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:59.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:02:59.397 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:02:59.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:59.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:02:59.504 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:02:59.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:02:59.587 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:02:59.587 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:02:59.644 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:02:59.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:02:59.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:02:59.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:00.261 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:00.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:00.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:00.371 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:00.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:00.449 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:00.449 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:00.507 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:00.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:00.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:00.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:00.646 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:00.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:00.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:00.754 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:00.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:00.840 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:00.840 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:00.897 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:00.898 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:00.898 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:00.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:01.510 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:01.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:01.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:01.618 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:01.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:01.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:01.692 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:01.749 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:01.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:01.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:01.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:01.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:01.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:01.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:02.011 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:02.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:02.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:02.099 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:02.156 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:02.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:02.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:02.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:02.751 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:02.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:02.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:02.860 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:02.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:02.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:02.934 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:02.992 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:02.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:02.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:02.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:03.159 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:03.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:03.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:03.267 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:03.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:03.344 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:03.344 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:03.402 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:03.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:03.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:03.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:03.994 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:03.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:03.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:04.106 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:04.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:04.188 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:04.189 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:04.246 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:04.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:04.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:04.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:04.403 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:04.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:04.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:04.511 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:04.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:04.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:04.590 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:04.647 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:04.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:04.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:04.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:05.247 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:05.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:05.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:05.356 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:05.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:05.429 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:05.429 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:05.487 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:05.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:05.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:05.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:05.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:05.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:05.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:05.758 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:05.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:05.841 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:05.841 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:05.899 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:05.899 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:05.899 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:05.899 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:06.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:06.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:06.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:06.599 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:06.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:06.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:06.682 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:06.738 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:06.738 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:06.738 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:06.738 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:06.900 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:06.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:06.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:07.009 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:07.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:07.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:07.091 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:07.148 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:07.148 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:07.148 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:07.148 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:07.739 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:07.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:07.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:07.816 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:07.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:07.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:07.907 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:07.965 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:07.965 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:07.965 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:07.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:08.149 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:08.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:08.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:08.257 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:08.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:08.332 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:08.332 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:08.389 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:08.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:08.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:08.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:08.966 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:08.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:08.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:09.057 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:09.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:09.141 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:09.141 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:09.197 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:09.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:09.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:09.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:09.391 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:09.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:09.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:09.498 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:09.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:09.573 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:09.573 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:09.632 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:09.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:09.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:09.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:10.199 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:10.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:10.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:10.322 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:10.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:10.402 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:10.403 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:10.459 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:10.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:10.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:10.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:10.634 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:10.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:10.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:10.741 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:10.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:10.813 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:10.813 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:10.870 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:10.870 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:10.870 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:10.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:11.461 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:11.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:11.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:11.575 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:11.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:11.663 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:11.664 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:11.721 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:11.721 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:11.721 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:11.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:11.871 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:11.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:11.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:11.979 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:12.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:12.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:12.054 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:12.111 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:12.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:12.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:12.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:12.723 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:12.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:12.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:12.831 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:12.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:12.907 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:12.907 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:12.964 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:12.964 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:12.964 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:12.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:13.113 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:13.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:13.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:13.220 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:13.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:13.308 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:13.309 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:13.366 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:13.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:13.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:13.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:13.965 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:13.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:13.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:14.075 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:14.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:14.152 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:14.153 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:14.210 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:14.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:14.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:14.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:14.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:14.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:14.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:14.476 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:14.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:14.551 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:14.552 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:14.608 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:14.608 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:14.608 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:14.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:15.213 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:15.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:15.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:15.320 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:15.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:15.398 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:15.398 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:15.456 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:15.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:15.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:15.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:15.610 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:15.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:15.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:15.717 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:15.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:15.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:15.802 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:15.859 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:15.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:15.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:15.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:16.459 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:16.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:16.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:16.565 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:16.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:16.641 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:16.642 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:16.698 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:16.699 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:16.699 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:16.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:16.861 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:16.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:16.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:16.968 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:17.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:17.041 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:17.041 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:17.098 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:17.098 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:17.098 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:17.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:17.700 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:17.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:17.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:17.809 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:17.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:17.891 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:17.892 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:17.949 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:17.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:17.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:17.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:18.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:18.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:18.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:18.206 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:18.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:18.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:18.291 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:18.348 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:18.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:18.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:18.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:18.951 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:18.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:18.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:19.060 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:19.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:19.133 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:19.133 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:19.190 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:19.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:19.191 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:19.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:19.350 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:19.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:19.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:19.457 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:19.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:19.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:19.536 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:19.593 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:19.594 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:19.594 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:19.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:20.192 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:20.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:20.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:20.301 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:20.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:20.377 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:20.377 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:20.434 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:20.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:20.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:20.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:20.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:20.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:20.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:20.702 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:20.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:20.776 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:20.776 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:20.833 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:20.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:20.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:20.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:21.436 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:21.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:21.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:21.545 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:21.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:21.621 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:21.621 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:21.678 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:21.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:21.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:21.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:21.835 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:21.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:21.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:21.943 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:22.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:22.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:22.017 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:22.074 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:22.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:22.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:22.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:22.679 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:22.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:22.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:22.787 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:22.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:22.868 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:22.868 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:22.925 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:22.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:22.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:22.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:23.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:23.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:23.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:23.183 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:23.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:23.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:23.273 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:23.330 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:23.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:23.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:23.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:23.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:23.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:23.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:24.035 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:24.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:24.118 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:24.118 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:24.175 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:24.176 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:24.176 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:24.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:24.332 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:24.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:24.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:24.441 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:24.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:24.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:24.524 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:24.581 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:24.581 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:24.581 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:24.582 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:25.177 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:25.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:25.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:25.286 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:25.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:25.362 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:25.362 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:25.420 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:25.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:25.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:25.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:25.583 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:25.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:25.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:25.690 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:25.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:25.770 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:25.770 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:25.827 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:25.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:25.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:25.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:26.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:26.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:26.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:26.531 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:26.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:26.610 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:26.610 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:26.667 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:26.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:26.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:26.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:26.829 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:26.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:26.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:26.937 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:27.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:27.022 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:27.023 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:27.080 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:27.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:27.081 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:27.081 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:27.670 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:27.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:27.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:27.796 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:27.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:27.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:27.874 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:27.931 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:27.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:27.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:27.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:28.082 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:28.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:28.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:28.189 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:28.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:28.273 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:28.274 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:28.331 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:28.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:28.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:28.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:28.933 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:28.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:28.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:29.042 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:29.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:29.131 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:29.131 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:29.188 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:29.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:29.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:29.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:29.333 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:29.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:29.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:29.441 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:29.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:29.528 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:29.528 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:29.585 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:29.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:29.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:29.586 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:30.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:30.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:30.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:30.298 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:30.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:30.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:30.374 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:30.431 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:30.432 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:30.432 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:30.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:30.587 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:30.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:30.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:30.695 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:30.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:30.777 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:30.777 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:30.834 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:30.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:30.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:30.835 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:31.434 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:31.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:31.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:31.543 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:31.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:31.628 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:31.628 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:31.686 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:31.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:31.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:31.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:31.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:31.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:31.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:31.943 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:32.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:32.035 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:32.035 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:32.093 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:32.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:32.094 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:32.094 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:32.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:32.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:32.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:32.796 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:32.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:32.871 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:32.871 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:32.929 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:32.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:32.929 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:32.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:33.095 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:33.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:33.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:33.202 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:33.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:33.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:33.275 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:33.332 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:33.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:33.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:33.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:33.930 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:33.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:33.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:34.039 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:34.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:34.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:34.117 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:34.174 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:34.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:34.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:34.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:34.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:34.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:34.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:34.441 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:34.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:34.513 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:34.513 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:34.570 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:34.571 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:34.571 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:34.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:35.176 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:35.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:35.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:35.284 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:35.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:35.372 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:35.372 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:35.428 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:35.429 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:35.429 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:35.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:35.572 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:35.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:35.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:35.680 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:35.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:35.768 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:35.769 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:35.826 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:35.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:35.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:35.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:36.430 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:36.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:36.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:36.539 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:36.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:36.619 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:36.619 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:36.677 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:36.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:36.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:36.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:36.829 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:36.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:36.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:36.936 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:37.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:37.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:37.017 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:37.074 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:37.074 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:37.074 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:37.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:37.679 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:37.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:37.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:37.789 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:37.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:37.865 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:37.865 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:37.923 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:37.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:37.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:37.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:38.076 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:38.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:38.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:38.184 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:38.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:38.268 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:38.268 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:38.325 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:38.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:38.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:38.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:38.925 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:38.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:38.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:39.034 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:39.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:39.110 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:39.111 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:39.168 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:39.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:39.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:39.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:39.327 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:39.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:39.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:39.393 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:39.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:39.482 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:39.482 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:39.540 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:39.540 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:39.541 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:39.541 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:40.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:40.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:40.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:40.279 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:40.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:40.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:40.355 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:40.413 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:40.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:40.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:40.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:40.541 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:40.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:40.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:40.648 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:40.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:40.723 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:40.723 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:40.780 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:40.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:40.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:40.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:41.415 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:41.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:41.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:41.524 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:41.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:41.603 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:41.603 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:41.660 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:41.661 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:41.661 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:41.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:41.782 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:41.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:41.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:41.889 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:41.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:41.963 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:41.963 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:42.020 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:42.020 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:42.021 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:42.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:42.662 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:42.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:42.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:42.770 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:42.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:42.860 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:42.860 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:42.917 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:42.918 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:42.918 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:42.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:43.022 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:43.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:43.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:43.129 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:43.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:43.207 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:43.207 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:43.265 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:43.265 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:43.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:43.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:43.919 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:43.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:43.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:44.027 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:44.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:44.103 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:44.103 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:44.161 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:44.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:44.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:44.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:44.267 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:44.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:44.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:44.373 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:44.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:44.462 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:44.462 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:44.519 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:44.519 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:44.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:44.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:45.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:45.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:45.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:45.272 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:45.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:45.360 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:45.360 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:45.417 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:45.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:45.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:45.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:45.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:45.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:45.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:45.628 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:45.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:45.717 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:45.717 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:45.775 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:45.775 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:45.775 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:45.775 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:46.419 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:46.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:46.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:46.491 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:46.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:46.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:46.572 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:46.630 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:46.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:46.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:46.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:46.777 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:46.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:46.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:46.885 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:46.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:46.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:46.960 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:47.016 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:47.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:47.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:47.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:47.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:47.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:47.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:47.699 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:47.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:47.774 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:47.774 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:47.832 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:47.832 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:47.833 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:47.833 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:48.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:48.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:48.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:48.126 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:48.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:48.195 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:48.195 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:48.253 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:48.254 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:48.254 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:48.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:48.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:48.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:48.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:48.942 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:49.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:49.028 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:49.028 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:49.085 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:49.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:49.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:49.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:49.255 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:49.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:49.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:49.335 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:49.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:49.408 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:49.408 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:49.467 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:49.467 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:49.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:49.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:50.088 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:50.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:50.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:50.201 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:50.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:50.275 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:50.275 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:50.332 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:50.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:50.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:50.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:50.469 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:50.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:50.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:50.529 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:50.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:50.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:50.615 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:50.671 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:50.671 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:50.671 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:50.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:51.333 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:51.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:51.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:51.434 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:51.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:51.517 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:51.517 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:51.574 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:51.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:51.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:51.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:51.672 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:51.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:51.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:51.733 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:51.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:51.812 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:51.812 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:51.869 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:51.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:51.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:51.870 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:52.574 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:52.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:52.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:52.634 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:52.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:52.708 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:52.708 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:52.765 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:52.765 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:52.765 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:52.765 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:52.871 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:52.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:52.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:52.978 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:53.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:53.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:53.055 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:53.112 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:53.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:53.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:53.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:53.766 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:53.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:53.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:53.826 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:53.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:53.914 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:53.915 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:53.971 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:53.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:53.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:53.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:54.114 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:54.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:54.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:54.221 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:54.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:54.297 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:54.297 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:54.355 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:54.355 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:54.355 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:54.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:54.971 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:54.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:54.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:55.079 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:55.154 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:55.154 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:55.154 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:55.212 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:55.212 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:55.212 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:55.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:55.357 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:55.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:55.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:55.461 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:55.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:55.541 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:55.541 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:55.598 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:55.598 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:55.598 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:55.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:56.213 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:56.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:56.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:56.322 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:56.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:56.412 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:56.413 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:56.470 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:56.470 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:56.470 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:56.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:56.600 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:56.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:56.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:56.706 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:56.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:56.796 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:56.796 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:56.853 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:56.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:56.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:56.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:57.472 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:57.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:57.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:57.580 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:57.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:57.659 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:57.659 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:57.717 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:57.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:57.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:57.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:57.855 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:57.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:57.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:57.963 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:58.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:58.037 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:58.037 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:58.094 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:58.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:58.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:58.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:58.719 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:58.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:58.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:58.827 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:03:58.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:58.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:58.912 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:03:58.969 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:58.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:58.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:58.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:59.096 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:03:59.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:59.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:03:59.203 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:03:59.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:03:59.290 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:03:59.290 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:03:59.347 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:03:59.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:03:59.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:03:59.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:03:59.971 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:03:59.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:03:59.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:00.077 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:00.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:00.157 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:00.157 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:00.216 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:00.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:00.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:00.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:00.349 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:00.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:00.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:00.456 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:00.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:00.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:00.536 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:00.593 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:00.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:00.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:00.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:01.218 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:01.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:01.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:01.327 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:01.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:01.410 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:01.410 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:01.468 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:01.468 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:01.468 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:01.468 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:01.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:01.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:01.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:01.702 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:01.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:01.782 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:01.782 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:01.839 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:01.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:01.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:01.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:02.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:02.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:02.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:02.579 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:02.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:02.664 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:02.664 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:02.721 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:02.722 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:02.722 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:02.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:02.841 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:02.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:02.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:02.947 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:03.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:03.019 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:03.019 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:03.076 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:03.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:03.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:03.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:03.723 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:03.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:03.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:03.784 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:03.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:03.862 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:03.863 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:03.919 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:03.919 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:03.919 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:03.919 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:04.078 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:04.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:04.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:04.138 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:04.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:04.211 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:04.211 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:04.268 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:04.268 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:04.268 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:04.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:04.920 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:04.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:04.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:04.981 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:05.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:05.063 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:05.063 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:05.119 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:05.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:05.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:05.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:05.269 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:05.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:05.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:05.329 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:05.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:05.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:05.403 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:05.459 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:05.460 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:05.460 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:05.460 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:06.120 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:06.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:06.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:06.181 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:06.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:06.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:06.259 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:06.316 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:06.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:06.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:06.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:06.460 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:06.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:06.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:06.520 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:06.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:06.600 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:06.601 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:06.657 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:06.657 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:06.657 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:06.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:07.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:07.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:07.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:07.377 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:07.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:07.453 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:07.453 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:07.510 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:07.510 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:07.510 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:07.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:07.658 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:07.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:07.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:07.718 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:07.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:07.807 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:07.807 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:07.863 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:07.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:07.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:07.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:08.511 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:08.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:08.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:08.619 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:08.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:08.691 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:08.691 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:08.748 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:08.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:08.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:08.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:08.864 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:08.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:08.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:08.973 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:09.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:09.065 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:09.065 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:09.122 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:09.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:09.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:09.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:09.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:09.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:09.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:09.810 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:09.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:09.887 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:09.887 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:09.944 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:09.944 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:09.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:09.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:10.124 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:10.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:10.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:10.232 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:10.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:10.309 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:10.309 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:10.366 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:10.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:10.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:10.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:10.945 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:10.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:10.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:11.006 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:11.088 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:11.088 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:11.088 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:11.145 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:11.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:11.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:11.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:11.368 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:11.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:11.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:11.449 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:11.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:11.531 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:11.531 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:11.587 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:11.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:11.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:11.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:12.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:12.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:12.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:12.207 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:12.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:12.288 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:12.289 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:12.346 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:12.346 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:12.346 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:12.346 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:12.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:12.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:12.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:12.648 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:12.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:12.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:12.729 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:12.786 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:12.787 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:12.787 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:12.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:13.348 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:13.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:13.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:13.456 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:13.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:13.542 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:13.542 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:13.600 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:13.601 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:13.601 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:13.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:13.788 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:13.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:13.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:13.895 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:13.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:13.969 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:13.969 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:14.026 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:14.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:14.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:14.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:14.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:14.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:14.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:14.710 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:14.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:14.786 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:14.786 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:14.844 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:14.844 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:14.844 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:14.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:15.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:15.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:15.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:15.134 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:15.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:15.217 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:15.217 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:15.274 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:15.275 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:15.275 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:15.275 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:15.845 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:15.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:15.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:15.954 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:16.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:16.027 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:16.027 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:16.084 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:16.085 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:16.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:16.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:16.276 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:16.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:16.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:16.384 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:16.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:16.458 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:16.459 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:16.515 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:16.515 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:16.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:16.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:17.086 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:17.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:17.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:17.193 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:17.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:17.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:17.273 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:17.330 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:17.331 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:17.331 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:17.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:17.517 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:17.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:17.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:17.625 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:17.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:17.704 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:17.704 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:17.761 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:17.761 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:17.761 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:17.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:18.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:18.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:18.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:18.440 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:18.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:18.517 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:18.517 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:18.574 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:18.575 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:18.575 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:18.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:18.762 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:18.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:18.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:18.870 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:18.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:18.949 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:18.949 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:19.007 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:19.007 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:19.008 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:19.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:19.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:19.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:19.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:19.684 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:19.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:19.757 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:19.758 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:19.814 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:19.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:19.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:19.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:20.009 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:20.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:20.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:20.116 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:20.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:20.201 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:20.201 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:20.259 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:20.259 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:20.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:20.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:20.816 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:20.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:20.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:20.924 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:21.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:21.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:21.012 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:21.069 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:21.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:21.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:21.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:21.260 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:21.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:21.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:21.369 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:21.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:21.446 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:21.446 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:21.503 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:21.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:21.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:21.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:22.071 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:22.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:22.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:22.181 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:22.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:22.258 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:22.258 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:22.315 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:22.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:22.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:22.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:22.505 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:22.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:22.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:22.614 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:22.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:22.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:22.691 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:22.748 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:22.748 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:22.748 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:22.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:23.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:23.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:23.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:23.426 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:23.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:23.505 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:23.505 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:23.562 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:23.563 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:23.563 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:23.563 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:23.749 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:23.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:23.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:23.856 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:23.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:23.931 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:23.931 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:23.988 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:23.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:23.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:23.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:24.564 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:24.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:24.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:24.673 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:24.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:24.746 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:24.746 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:24.803 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:24.803 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:24.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:24.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:24.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:24.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:24.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:25.098 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:25.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:25.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:25.174 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:25.232 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:25.232 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:25.232 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:25.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:25.805 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:25.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:25.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:25.914 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:25.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:25.992 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:25.992 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:26.049 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:26.050 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:26.050 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:26.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:26.233 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:26.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:26.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:26.343 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:26.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:26.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:26.418 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:26.475 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:26.475 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:26.475 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:26.476 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:27.051 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:27.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:27.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:27.160 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:27.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:27.235 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:27.235 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:27.292 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:27.293 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:27.293 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:27.293 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:27.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:27.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:27.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:27.584 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:27.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:27.660 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:27.660 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:27.717 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:27.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:27.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:27.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:28.295 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:28.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:28.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:28.402 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:28.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:28.477 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:28.478 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:28.534 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:28.535 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:28.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:28.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:28.719 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:28.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:28.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:28.827 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:28.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:28.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:28.900 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:28.957 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:28.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:28.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:28.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:29.536 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:29.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:29.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:29.644 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:29.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:29.719 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:29.719 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:29.776 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:29.776 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:29.776 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:29.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:29.959 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:29.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:29.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:30.066 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:30.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:30.145 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:30.145 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:30.203 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:30.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:30.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:30.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:30.778 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:30.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:30.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:30.886 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:30.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:30.970 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:30.970 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:31.028 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:31.028 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:31.028 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:31.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:31.205 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:31.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:31.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:31.314 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:31.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:31.397 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:31.397 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:31.453 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:31.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:31.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:31.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:32.029 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:32.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:32.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:32.137 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:32.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:32.207 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:32.207 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:32.264 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:32.264 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:32.265 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:32.265 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:32.455 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:32.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:32.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:32.562 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:32.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:32.637 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:32.637 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:32.694 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:32.695 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:32.695 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:32.695 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:33.265 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:33.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:33.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:33.373 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:33.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:33.445 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:33.445 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:33.502 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:33.503 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:33.503 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:33.503 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:33.696 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:33.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:33.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:33.804 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:33.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:33.883 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:33.883 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:33.941 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:33.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:33.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:33.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:34.504 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:34.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:34.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:34.612 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:34.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:34.691 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:34.691 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:34.748 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:34.749 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:34.749 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:34.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:34.942 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:34.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:34.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:35.049 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:35.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:35.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:35.140 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:35.197 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:35.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:35.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:35.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:35.751 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:35.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:35.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:35.858 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:35.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:35.931 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:35.931 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:35.988 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:35.989 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:35.989 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:35.989 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:36.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:36.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:36.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:36.306 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:36.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:36.387 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:36.388 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:36.445 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:36.445 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:36.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:36.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:36.990 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:36.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:36.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:37.098 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:37.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:37.187 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:37.187 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:37.244 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:37.245 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:37.245 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:37.245 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:37.447 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:37.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:37.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:37.554 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:37.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:37.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:37.646 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:37.703 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:37.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:37.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:37.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:38.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:38.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:38.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:38.359 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:38.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:38.434 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:38.434 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:38.493 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:38.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:38.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:38.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:38.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:38.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:38.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:38.813 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:38.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:38.900 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:38.900 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:38.957 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:38.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:38.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:38.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:39.494 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:39.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:39.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:39.603 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:39.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:39.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:39.682 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:39.739 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:39.739 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:39.739 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:39.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:39.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:39.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:39.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:40.066 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:40.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:40.142 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:40.142 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:40.199 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:40.199 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:40.199 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:40.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:40.741 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:40.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:40.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:40.850 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:40.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:40.924 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:40.925 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:40.982 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:40.982 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:40.982 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:40.982 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:41.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:41.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:41.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:41.308 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:41.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:41.392 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:41.392 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:41.450 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:41.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:41.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:41.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:41.984 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:41.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:41.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:42.092 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:42.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:42.172 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:42.172 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:42.229 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:42.229 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:42.229 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:42.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:42.452 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:42.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:42.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:42.559 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:42.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:42.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:42.652 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:42.709 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:42.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:42.709 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:42.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:43.231 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:43.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:43.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:43.339 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:43.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:43.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:43.420 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:43.478 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:43.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:43.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:43.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:43.711 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:43.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:43.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:43.819 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:43.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:43.905 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:43.905 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:43.962 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:43.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:43.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:43.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:44.480 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:44.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:44.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:44.590 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:44.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:44.662 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:44.662 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:44.719 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:44.719 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:44.719 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:44.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:44.963 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:44.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:44.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:45.070 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:45.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:45.161 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:45.162 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:45.218 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:45.219 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:45.219 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:45.219 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:45.721 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:45.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:45.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:45.831 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:45.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:45.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:45.913 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:45.970 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:45.970 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:45.970 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:45.970 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:46.220 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:46.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:46.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:46.328 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:46.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:46.406 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:46.406 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:46.463 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:46.463 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:46.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:46.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:46.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:46.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:46.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:47.082 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:47.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:47.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:47.158 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:47.215 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:47.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:47.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:47.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:47.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:47.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:47.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:47.575 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:47.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:47.660 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:47.660 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:47.717 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:47.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:47.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:47.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:48.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:48.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:48.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:48.325 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:48.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:48.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:48.401 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:48.458 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:48.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:48.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:48.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:48.719 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:48.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:48.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:48.826 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:48.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:48.915 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:48.915 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:48.972 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:48.973 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:48.973 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:48.973 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:49.460 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:49.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:49.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:49.569 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:49.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:49.651 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:49.651 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:49.708 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:49.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:49.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:49.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:49.974 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:49.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:49.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:50.082 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:50.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:50.158 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:50.158 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:50.215 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:50.216 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:50.216 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:50.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:50.710 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:50.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:50.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:50.818 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:50.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:50.895 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:50.895 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:50.952 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:50.952 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:50.953 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:50.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:51.217 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:51.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:51.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:51.325 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:51.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:51.397 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:51.397 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:51.454 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:51.455 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:51.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:51.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:51.954 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:51.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:51.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:52.062 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:52.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:52.144 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:52.144 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:52.203 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:52.203 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:52.203 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:52.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:52.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:52.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:52.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:52.563 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:52.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:52.651 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:52.651 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:52.708 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:52.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:52.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:52.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:53.204 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:53.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:53.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:53.312 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:53.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:53.392 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:53.392 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:53.450 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:53.450 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:53.450 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:53.450 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:53.710 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:53.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:53.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:53.819 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:53.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:53.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:53.910 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:53.967 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:53.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:53.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:53.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:54.451 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:54.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:54.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:54.559 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:54.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:54.646 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:54.646 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:54.702 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:54.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:54.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:54.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:54.970 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:54.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:54.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:55.078 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:55.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:55.151 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:55.151 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:55.208 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:55.208 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:55.208 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:55.208 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:55.704 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:55.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:55.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:55.814 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:55.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:55.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:55.902 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:55.959 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:55.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:55.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:55.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:56.209 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:56.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:56.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:56.318 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:56.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:56.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:56.400 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:56.458 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:56.459 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:56.459 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:56.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:56.960 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:56.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:56.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:57.070 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:57.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:57.148 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:57.148 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:57.205 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:57.205 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:57.205 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:57.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:57.460 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:57.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:57.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:57.569 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:57.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:57.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:57.646 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:57.703 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:57.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:57.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:57.704 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:58.207 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:58.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:58.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:58.317 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:58.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:58.391 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:58.392 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:58.449 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:58.449 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:58.449 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:58.449 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:58.704 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:58.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:58.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:58.812 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:04:58.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:58.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:58.888 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:04:58.946 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:58.946 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:58.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:58.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:59.449 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:04:59.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:59.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:04:59.559 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:04:59.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:04:59.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:04:59.633 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:04:59.691 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:04:59.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:04:59.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:04:59.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:04:59.948 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:04:59.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:04:59.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:00.058 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:00.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:00.131 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:00.132 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:00.188 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:00.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:00.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:00.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:00.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:00.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:00.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:00.803 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:00.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:00.878 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:00.878 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:00.935 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:00.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:00.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:00.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:01.190 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:01.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:01.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:01.299 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:01.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:01.383 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:01.383 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:01.440 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:01.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:01.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:01.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:01.938 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:01.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:01.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:02.047 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:02.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:02.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:02.121 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:02.179 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:02.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:02.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:02.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:02.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:02.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:02.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:02.553 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:02.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:02.636 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:02.636 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:02.693 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:02.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:02.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:02.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:03.181 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:03.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:03.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:03.290 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:03.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:03.377 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:03.377 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:03.435 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:03.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:03.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:03.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:03.696 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:03.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:03.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:03.805 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:03.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:03.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:03.878 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:03.935 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:03.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:03.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:03.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:04.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:04.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:04.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:04.547 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:04.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:04.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:04.627 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:04.684 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:04.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:04.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:04.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:04.937 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:04.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:04.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:05.046 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:05.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:05.123 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:05.123 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:05.180 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:05.180 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:05.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:05.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:05.685 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:05.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:05.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:05.794 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:05.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:05.867 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:05.867 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:05.925 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:05.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:05.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:05.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:06.182 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:06.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:06.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:06.290 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:06.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:06.365 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:06.365 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:06.421 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:06.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:06.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:06.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:06.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:06.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:06.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:07.035 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:07.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:07.120 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:07.120 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:07.176 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:07.177 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:07.177 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:07.177 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:07.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:07.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:07.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:07.531 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:07.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:07.606 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:07.606 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:07.663 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:07.663 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:07.663 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:07.664 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:08.178 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:08.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:08.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:08.287 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:08.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:08.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:08.363 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:08.420 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:08.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:08.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:08.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:08.665 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:08.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:08.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:08.773 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:08.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:08.856 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:08.857 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:08.913 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:08.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:08.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:08.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:09.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:09.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:09.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:09.530 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:09.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:09.619 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:09.619 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:09.676 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:09.677 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:09.677 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:09.677 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:09.916 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:09.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:09.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:10.024 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:10.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:10.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:10.099 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:10.157 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:10.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:10.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:10.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:10.678 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:10.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:10.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:10.761 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:10.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:10.834 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:10.834 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:10.892 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:10.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:10.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:10.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:11.159 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:11.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:11.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:11.266 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:11.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:11.347 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:11.347 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:11.405 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:11.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:11.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:11.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:11.894 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:11.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:11.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:12.003 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:12.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:12.076 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:12.076 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:12.134 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:12.135 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:12.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:12.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:12.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:12.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:12.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:12.515 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:12.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:12.588 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:12.588 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:12.645 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:12.646 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:12.646 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:12.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:13.136 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:13.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:13.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:13.244 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:13.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:13.330 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:13.330 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:13.388 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:13.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:13.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:13.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:13.647 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:13.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:13.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:13.754 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:13.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:13.839 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:13.839 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:13.896 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:13.897 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:13.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:13.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:14.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:14.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:14.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:14.498 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:14.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:14.578 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:14.578 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:14.635 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:14.636 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:14.636 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:14.636 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:14.898 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:14.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:14.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:15.006 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:15.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:15.094 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:15.094 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:15.151 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:15.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:15.152 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:15.152 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:15.637 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:15.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:15.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:15.698 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:15.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:15.773 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:15.773 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:15.831 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:15.831 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:15.831 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:15.831 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:16.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:16.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:16.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:16.219 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:16.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:16.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:16.291 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:16.348 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:16.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:16.348 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:16.348 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:16.832 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:16.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:16.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:16.946 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:17.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:17.022 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:17.022 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:17.079 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:17.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:17.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:17.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:17.349 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:17.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:17.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:17.474 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:17.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:17.552 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:17.552 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:17.610 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:17.610 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:17.610 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:17.610 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:18.081 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:18.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:18.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:18.220 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:18.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:18.299 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:18.300 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:18.357 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:18.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:18.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:18.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:18.610 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:18.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:18.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:18.717 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:18.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:18.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:18.802 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:18.859 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:18.859 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:18.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:18.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:19.359 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:19.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:19.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:19.465 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:19.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:19.542 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:19.542 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:19.600 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:19.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:19.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:19.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:19.861 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:19.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:19.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:19.969 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:20.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:20.048 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:20.049 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:20.105 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:20.106 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:20.106 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:20.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:20.601 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:20.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:20.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:20.709 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:20.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:20.782 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:20.783 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:20.840 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:20.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:20.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:20.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:21.107 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:21.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:21.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:21.214 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:21.296 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:21.296 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:21.296 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:21.353 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:21.354 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:21.354 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:21.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:21.841 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:21.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:21.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:21.949 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:22.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:22.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:22.038 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:22.095 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:22.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:22.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:22.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:22.355 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:22.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:22.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:22.462 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:22.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:22.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:22.550 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:22.607 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:22.607 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:22.607 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:22.608 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:23.097 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:23.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:23.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:23.236 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:23.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:23.325 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:23.325 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:23.382 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:23.383 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:23.383 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:23.383 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:23.608 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:23.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:23.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:23.716 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:23.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:23.804 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:23.804 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:23.861 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:23.861 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:23.861 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:23.861 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:24.384 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:24.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:24.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:24.517 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:24.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:24.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:24.608 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:24.665 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:24.665 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:24.665 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:24.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:24.862 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:24.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:24.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:24.933 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:25.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:25.008 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:25.009 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:25.066 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:25.066 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:25.066 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:25.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:25.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:25.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:25.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:25.733 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:25.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:25.806 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:25.806 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:25.863 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:25.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:25.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:25.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:26.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:26.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:26.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:26.175 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:26.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:26.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:26.259 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:26.316 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:26.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:26.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:26.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:26.865 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:26.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:26.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:26.978 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:27.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:27.064 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:27.064 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:27.121 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:27.122 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:27.122 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:27.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:27.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:27.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:27.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:27.425 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:27.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:27.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:27.509 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:27.566 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:27.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:27.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:27.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:28.123 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:28.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:28.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:28.231 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:28.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:28.320 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:28.320 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:28.378 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:28.378 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:28.379 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:28.379 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:28.568 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:28.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:28.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:28.675 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:28.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:28.755 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:28.755 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:28.812 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:28.813 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:28.813 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:28.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:29.379 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:29.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:29.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:29.488 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:29.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:29.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:29.572 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:29.629 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:29.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:29.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:29.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:29.814 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:29.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:29.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:29.930 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:30.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:30.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:30.011 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:30.068 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:30.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:30.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:30.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:30.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:30.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:30.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:30.740 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:30.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:30.830 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:30.831 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:30.888 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:30.888 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:30.888 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:30.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:31.069 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:31.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:31.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:31.177 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:31.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:31.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:31.259 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:31.316 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:31.316 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:31.316 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:31.316 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:31.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:31.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:31.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:31.998 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:32.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:32.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:32.069 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:32.126 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:32.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:32.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:32.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:32.317 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:32.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:32.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:32.424 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:32.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:32.507 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:32.507 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:32.565 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:32.565 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:32.565 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:32.565 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:33.128 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:33.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:33.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:33.195 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:33.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:33.268 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:33.268 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:33.325 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:33.325 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:33.325 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:33.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:33.567 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:33.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:33.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:33.674 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:33.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:33.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:33.758 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:33.816 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:33.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:33.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:33.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:34.326 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:34.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:34.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:34.435 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:34.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:34.513 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:34.513 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:34.570 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:34.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:34.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:34.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:34.818 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:34.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:34.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:34.925 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:35.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:35.003 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:35.003 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:35.060 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:35.060 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:35.060 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:35.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:35.571 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:35.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:35.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:35.680 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:35.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:35.758 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:35.758 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:35.815 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:35.816 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:35.816 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:35.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:36.061 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:36.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:36.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:36.169 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:36.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:36.244 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:36.244 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:36.301 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:36.302 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:36.302 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:36.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:36.817 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:36.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:36.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:36.926 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:37.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:37.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:37.012 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:37.069 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:37.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:37.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:37.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:37.304 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:37.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:37.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:37.411 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:37.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:37.494 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:37.494 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:37.551 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:37.552 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:37.552 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:37.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:38.071 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:38.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:38.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:38.180 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:38.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:38.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:38.270 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:38.327 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:38.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:38.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:38.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:38.553 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:38.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:38.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:38.659 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:38.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:38.735 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:38.735 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:38.793 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:38.793 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:38.793 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:38.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:39.329 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:39.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:39.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:39.435 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:39.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:39.506 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:39.506 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:39.564 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:39.564 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:39.564 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:39.564 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:39.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:39.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:39.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:39.900 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:39.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:39.976 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:39.976 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:40.033 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:40.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:40.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:40.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:40.565 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:40.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:40.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:40.699 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:40.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:40.790 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:40.790 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:40.847 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:40.848 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:40.848 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:40.848 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:41.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:41.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:41.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:41.128 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:41.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:41.213 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:41.213 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:41.270 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:41.270 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:41.270 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:41.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:41.849 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:41.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:41.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:41.943 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:42.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:42.032 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:42.032 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:42.089 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:42.089 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:42.089 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:42.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:42.271 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:42.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:42.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:42.363 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:42.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:42.444 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:42.444 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:42.501 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:42.501 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:42.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:42.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:43.091 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:43.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:43.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:43.180 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:43.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:43.253 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:43.253 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:43.310 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:43.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:43.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:43.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:43.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:43.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:43.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:43.562 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:43.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:43.649 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:43.649 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:43.706 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:43.706 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:43.707 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:43.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:44.311 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:44.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:44.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:44.418 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:44.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:44.506 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:44.507 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:44.565 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:44.565 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:44.565 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:44.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:44.708 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:44.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:44.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:44.815 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:44.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:44.899 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:44.899 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:44.956 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:44.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:44.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:44.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:45.566 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:45.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:45.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:45.674 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:45.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:45.756 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:45.757 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:45.814 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:45.815 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:45.815 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:45.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:45.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:45.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:45.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:46.065 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:46.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:46.138 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:46.138 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:46.195 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:46.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:46.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:46.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:46.817 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:46.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:46.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:46.926 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:47.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:47.010 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:47.011 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:47.068 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:47.068 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:47.068 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:47.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:47.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:47.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:47.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:47.303 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:47.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:47.383 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:47.383 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:47.440 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:47.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:47.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:47.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:48.070 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:48.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:48.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:48.180 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:48.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:48.267 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:48.267 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:48.326 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:48.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:48.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:48.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:48.442 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:48.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:48.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:48.550 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:48.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:48.644 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:48.644 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:48.701 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:48.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:48.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:48.702 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:49.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:49.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:49.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:49.438 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:49.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:49.526 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:49.526 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:49.584 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:49.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:49.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:49.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:49.703 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:49.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:49.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:49.810 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:49.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:49.883 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:49.883 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:49.940 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:49.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:49.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:49.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:50.586 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:50.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:50.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:50.693 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:50.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:50.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:50.770 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:50.827 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:50.828 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:50.828 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:50.828 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:50.942 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:50.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:50.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:51.049 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:51.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:51.123 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:51.123 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:51.181 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:51.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:51.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:51.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:51.830 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:51.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:51.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:51.960 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:52.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:52.034 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:52.034 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:52.091 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:52.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:52.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:52.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:52.183 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:52.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:52.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:52.289 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:52.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:52.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:52.377 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:52.435 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:52.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:52.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:52.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:53.092 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:53.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:53.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:53.229 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:53.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:53.304 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:53.304 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:53.360 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:53.361 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:53.361 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:53.361 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:53.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:53.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:53.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:53.544 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:53.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:53.617 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:53.617 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:53.674 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:53.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:53.675 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:53.675 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:54.362 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:54.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:54.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:54.489 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:54.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:54.564 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:54.564 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:54.622 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:54.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:54.622 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:54.622 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:54.676 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:54.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:54.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:54.782 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:54.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:54.856 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:54.856 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:54.913 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:54.914 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:54.914 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:54.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:55.623 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:55.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:55.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:55.732 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:55.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:55.808 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:55.808 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:55.865 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:55.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:55.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:55.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:55.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:55.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:55.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:56.021 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:56.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:56.102 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:56.102 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:56.159 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:56.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:56.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:56.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:56.867 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:56.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:56.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:56.974 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:57.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:57.054 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:57.054 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:57.111 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:57.111 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:57.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:57.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:57.160 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:57.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:57.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:57.267 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:57.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:57.345 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:57.345 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:57.402 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:57.402 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:57.402 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:57.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:58.113 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:58.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:58.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:58.221 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:58.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:58.302 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:58.302 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:58.359 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:58.359 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:58.359 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:58.359 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:58.404 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:58.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:58.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:58.510 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:58.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:58.587 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:58.587 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:58.645 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:58.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:58.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:58.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:59.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:05:59.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:59.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:59.468 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:05:59.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:05:59.543 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:59.543 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:05:59.600 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:59.600 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:59.600 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:59.600 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:05:59.646 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:05:59.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:59.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:05:59.752 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:05:59.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:05:59.839 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:05:59.839 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:05:59.896 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:05:59.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:05:59.896 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:05:59.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:00.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:00.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:00.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:00.710 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:00.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:00.789 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:00.789 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:00.849 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:00.849 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:00.849 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:00.849 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:00.897 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:00.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:00.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:01.004 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:01.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:01.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:01.078 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:01.136 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:01.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:01.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:01.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:01.851 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:01.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:01.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:01.959 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:02.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:02.035 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:02.035 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:02.091 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:02.092 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:02.092 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:02.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:02.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:02.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:02.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:02.244 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:02.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:02.326 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:02.327 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:02.384 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:02.385 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:02.385 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:02.385 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:03.093 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:03.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:03.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:03.202 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:03.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:03.277 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:03.277 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:03.335 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:03.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:03.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:03.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:03.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:03.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:03.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:03.492 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:03.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:03.581 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:03.581 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:03.638 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:03.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:03.639 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:03.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:04.337 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:04.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:04.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:04.445 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:04.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:04.519 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:04.519 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:04.577 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:04.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:04.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:04.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:04.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:04.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:04.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:04.746 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:04.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:04.829 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:04.829 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:04.886 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:04.887 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:04.887 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:04.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:05.579 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:05.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:05.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:05.687 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:05.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:05.771 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:05.771 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:05.828 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:05.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:05.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:05.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:05.888 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:05.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:05.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:05.994 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:06.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:06.077 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:06.077 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:06.134 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:06.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:06.135 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:06.135 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:06.830 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:06.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:06.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:06.939 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:07.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:07.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:07.018 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:07.076 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:07.077 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:07.077 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:07.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:07.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:07.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:07.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:07.242 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:07.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:07.324 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:07.324 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:07.381 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:07.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:07.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:07.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:08.078 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:08.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:08.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:08.190 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:08.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:08.272 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:08.272 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:08.330 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:08.330 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:08.330 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:08.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:08.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:08.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:08.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:08.490 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:08.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:08.566 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:08.566 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:08.623 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:08.624 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:08.624 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:08.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:09.332 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:09.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:09.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:09.399 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:09.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:09.480 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:09.480 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:09.538 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:09.538 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:09.538 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:09.538 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:09.625 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:09.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:09.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:09.731 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:09.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:09.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:09.802 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:09.859 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:09.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:09.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:09.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:10.539 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:10.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:10.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:10.603 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:10.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:10.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:10.677 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:10.734 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:10.734 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:10.734 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:10.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:10.861 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:10.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:10.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:10.969 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:11.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:11.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:11.054 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:11.111 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:11.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:11.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:11.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:11.735 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:11.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:11.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:11.824 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:11.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:11.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:11.899 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:11.957 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:11.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:11.958 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:11.958 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:12.114 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:12.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:12.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:12.221 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:12.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:12.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:12.295 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:12.352 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:12.352 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:12.352 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:12.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:12.959 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:12.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:12.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:13.047 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:13.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:13.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:13.130 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:13.188 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:13.188 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:13.188 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:13.188 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:13.354 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:13.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:13.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:13.424 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:13.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:13.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:13.508 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:13.565 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:13.565 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:13.565 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:13.565 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:14.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:14.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:14.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:14.276 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:14.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:14.363 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:14.363 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:14.420 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:14.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:14.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:14.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:14.567 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:14.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:14.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:14.675 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:14.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:14.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:14.754 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:14.811 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:14.812 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:14.812 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:14.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:15.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:15.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:15.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:15.511 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:15.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:15.585 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:15.585 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:15.642 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:15.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:15.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:15.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:15.813 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:15.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:15.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:15.884 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:15.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:15.957 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:15.958 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:16.015 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:16.015 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:16.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:16.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:16.644 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:16.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:16.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:16.752 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:16.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:16.842 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:16.843 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:16.900 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:16.900 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:16.900 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:16.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:17.017 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:17.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:17.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:17.080 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:17.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:17.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:17.169 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:17.226 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:17.226 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:17.226 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:17.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:17.902 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:17.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:17.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:17.976 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:18.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:18.063 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:18.063 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:18.120 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:18.120 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:18.120 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:18.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:18.228 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:18.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:18.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:18.301 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:18.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:18.374 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:18.374 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:18.431 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:18.431 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:18.431 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:18.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:19.121 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:19.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:19.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:19.230 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:19.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:19.315 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:19.315 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:19.373 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:19.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:19.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:19.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:19.433 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:19.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:19.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:19.523 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:19.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:19.596 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:19.596 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:19.653 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:19.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:19.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:19.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:20.375 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:20.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:20.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:20.483 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:20.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:20.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:20.556 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:20.615 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:20.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:20.615 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:20.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:20.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:20.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:20.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:20.748 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:20.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:20.820 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:20.820 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:20.877 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:20.877 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:20.877 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:20.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:21.617 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:21.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:21.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:21.726 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:21.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:21.797 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:21.797 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:21.855 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:21.856 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:21.856 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:21.856 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:21.878 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:21.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:21.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:21.991 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:22.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:22.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:22.060 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:22.117 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:22.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:22.117 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:22.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:22.858 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:22.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:22.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:22.966 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:23.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:23.058 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:23.058 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:23.117 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:23.118 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:23.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:23.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:23.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:23.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:23.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:23.245 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:23.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:23.325 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:23.325 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:23.382 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:23.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:23.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:23.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:24.119 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:24.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:24.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:24.227 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:24.303 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:24.303 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:24.303 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:24.359 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:24.360 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:24.360 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:24.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:24.384 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:24.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:24.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:24.501 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:24.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:24.579 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:24.579 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:24.637 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:24.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:24.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:24.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:25.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:25.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:25.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:25.470 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:25.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:25.554 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:25.554 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:25.611 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:25.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:25.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:25.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:25.638 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:25.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:25.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:25.723 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:25.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:25.805 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:25.805 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:25.862 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:25.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:25.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:25.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:26.612 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:26.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:26.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:26.720 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:26.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:26.797 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:26.797 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:26.855 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:26.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:26.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:26.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:26.864 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:26.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:26.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:26.968 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:27.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:27.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:27.042 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:27.100 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:27.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:27.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:27.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:27.857 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:27.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:27.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:27.965 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:28.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:28.041 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:28.041 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:28.098 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:28.099 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:28.099 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:28.099 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:28.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:28.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:28.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:28.233 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:28.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:28.313 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:28.313 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:28.369 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:28.369 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:28.369 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:28.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:29.100 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:29.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:29.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:29.195 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:29.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:29.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:29.270 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:29.327 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:29.327 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:29.327 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:29.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:29.370 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:29.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:29.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:29.499 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:29.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:29.577 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:29.577 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:29.633 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:29.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:29.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:29.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:30.329 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:30.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:30.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:30.435 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:30.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:30.508 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:30.509 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:30.566 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:30.566 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:30.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:30.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:30.634 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:30.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:30.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:30.741 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:30.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:30.820 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:30.820 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:30.877 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:30.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:30.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:30.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:31.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:31.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:31.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:31.676 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:31.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:31.761 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:31.761 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:31.819 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:31.819 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:31.819 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:31.819 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:31.879 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:31.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:31.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:31.987 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:32.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:32.069 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:32.069 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:32.126 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:32.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:32.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:32.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:32.821 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:32.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:32.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:32.929 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:33.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:33.002 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:33.002 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:33.061 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:33.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:33.061 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:33.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:33.128 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:33.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:33.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:33.235 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:33.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:33.308 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:33.308 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:33.365 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:33.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:33.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:33.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:34.063 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:34.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:34.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:34.170 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:34.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:34.244 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:34.244 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:34.302 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:34.303 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:34.303 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:34.303 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:34.368 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:34.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:34.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:34.474 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:34.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:34.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:34.548 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:34.606 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:34.606 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:34.606 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:34.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:35.304 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:35.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:35.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:35.408 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:35.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:35.484 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:35.484 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:35.541 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:35.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:35.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:35.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:35.608 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:35.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:35.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:35.714 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:35.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:35.795 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:35.795 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:35.852 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:35.852 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:35.852 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:35.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:36.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:36.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:36.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:36.652 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:36.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:36.741 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:36.741 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:36.798 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:36.799 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:36.799 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:36.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:36.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:36.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:36.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:36.962 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:37.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:37.036 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:37.036 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:37.093 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:37.093 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:37.093 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:37.093 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:37.800 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:37.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:37.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:37.909 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:37.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:37.995 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:37.995 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:38.053 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:38.053 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:38.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:38.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:38.094 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:38.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:38.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:38.200 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:38.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:38.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:38.275 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:38.332 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:38.332 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:38.332 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:38.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:39.055 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:39.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:39.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:39.163 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:39.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:39.239 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:39.239 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:39.296 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:39.297 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:39.297 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:39.297 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:39.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:39.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:39.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:39.439 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:39.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:39.512 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:39.512 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:39.569 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:39.570 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:39.570 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:39.570 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:40.298 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:40.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:40.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:40.407 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:40.490 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:40.490 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:40.490 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:40.548 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:40.548 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:40.548 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:40.548 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:40.571 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:40.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:40.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:40.677 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:40.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:40.760 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:40.760 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:40.817 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:40.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:40.818 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:40.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:41.550 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:41.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:41.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:41.685 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:41.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:41.760 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:41.760 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:41.817 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:41.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:41.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:41.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:41.818 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:41.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:41.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:41.919 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:42.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:42.005 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:42.005 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:42.063 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:42.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:42.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:42.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:42.818 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:42.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:42.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:42.927 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:43.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:43.006 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:43.006 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:43.063 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:43.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:43.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:43.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:43.065 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:43.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:43.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:43.169 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:43.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:43.256 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:43.256 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:43.313 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:43.314 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:43.314 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:43.314 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:44.066 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:44.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:44.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:44.195 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:44.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:44.279 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:44.279 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:44.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:44.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:44.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:44.403 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:44.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:44.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:44.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:44.412 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:44.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:44.494 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:44.494 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:44.551 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:44.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:44.552 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:44.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:45.404 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:45.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:45.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:45.469 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:45.553 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:45.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:45.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:45.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:45.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:45.556 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:45.632 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:45.641 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:45.641 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:45.641 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:45.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:45.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:45.706 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:45.707 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:45.764 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:45.764 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:45.764 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:45.764 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:46.642 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:46.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:46.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:46.750 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:46.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:46.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:46.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:46.838 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:46.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:46.846 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:46.846 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:46.904 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:46.904 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:46.904 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:46.904 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:46.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:46.915 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:46.915 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:46.972 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:46.972 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:46.972 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:46.972 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:47.906 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:47.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:47.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:47.989 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:47.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:47.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:48.040 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:48.049 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:48.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:48.059 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:48.059 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:48.116 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:48.116 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:48.116 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:48.116 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:48.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:48.128 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:48.128 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:48.185 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:48.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:48.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:48.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:49.117 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:49.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:49.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:49.218 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:49.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:49.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:49.270 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:49.279 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:49.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:49.288 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:49.288 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:49.345 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:49.345 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:49.345 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:49.345 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:49.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:49.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:49.355 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:49.412 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:49.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:49.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:49.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:50.346 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:50.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:50.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:50.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:50.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:50.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:50.505 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:50.514 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:50.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:50.523 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:50.523 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:50.580 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:50.580 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:50.580 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:50.580 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:50.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:50.587 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:50.588 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:50.645 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:50.645 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:50.645 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:50.645 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:51.580 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:51.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:51.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:51.679 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:51.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:51.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:51.731 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:51.740 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:51.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:51.749 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:51.749 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:51.806 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:51.806 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:51.806 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:51.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:51.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:51.817 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:51.817 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:51.875 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:51.875 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:51.875 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:51.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:52.807 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:52.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:52.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:52.905 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:52.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:52.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:52.958 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:52.967 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:52.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:52.976 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:52.976 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:53.033 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:53.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:53.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:53.033 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:53.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:53.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:53.050 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:53.108 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:53.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:53.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:53.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:54.034 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:54.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:54.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:54.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:54.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:54.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:54.185 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:54.194 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:54.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:54.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:54.202 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:54.258 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:54.258 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:54.259 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:54.259 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:54.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:54.277 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:54.277 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:54.334 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:54.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:54.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:54.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:55.260 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:55.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:55.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:55.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:55.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:55.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:55.409 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:55.417 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:55.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:55.426 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:55.426 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:55.483 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:55.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:55.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:55.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:55.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:55.504 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:55.504 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:55.561 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:55.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:55.562 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:55.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:56.485 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:56.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:56.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:56.584 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:56.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:56.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:56.636 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:56.645 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:56.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:56.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:56.654 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:56.711 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:56.711 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:56.711 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:56.711 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:56.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:56.728 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:56.728 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:56.785 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:56.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:56.786 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:56.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:57.712 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:57.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:57.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:57.810 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:57.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:57.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:57.862 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:57.871 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:57.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:57.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:57.880 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:57.937 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:57.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:57.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:57.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:57.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:57.945 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:57.945 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:58.002 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:58.002 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:58.002 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:58.002 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:58.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:06:58.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:58.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:59.036 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:06:59.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:59.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:06:59.088 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:06:59.096 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:06:59.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:06:59.105 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:59.105 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:06:59.162 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:59.163 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:59.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:59.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:06:59.179 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:06:59.179 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:06:59.179 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:06:59.236 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:06:59.237 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:06:59.237 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:06:59.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:00.164 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:00.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:00.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:00.263 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:00.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:00.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:00.315 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:00.324 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:00.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:00.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:00.333 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:00.390 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:00.390 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:00.390 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:00.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:00.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:00.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:00.394 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:00.454 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:00.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:00.454 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:00.454 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:01.391 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:01.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:01.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:01.488 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:01.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:01.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:01.540 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:01.549 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:01.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:01.558 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:01.558 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:01.614 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:01.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:01.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:01.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:01.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:01.625 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:01.625 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:01.683 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:01.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:01.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:01.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:02.615 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:02.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:02.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:02.714 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:02.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:02.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:02.767 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:02.775 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:02.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:02.784 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:02.784 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:02.841 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:02.841 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:02.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:02.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:02.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:02.850 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:02.850 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:02.907 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:02.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:02.908 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:02.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:03.842 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:03.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:03.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:03.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:03.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:03.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:03.989 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:03.997 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:04.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:04.006 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:04.006 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:04.063 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:04.063 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:04.063 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:04.063 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:04.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:04.073 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:04.074 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:04.131 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:04.131 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:04.131 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:04.132 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:05.064 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:05.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:05.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:05.163 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:05.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:05.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:05.240 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:05.250 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:05.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:05.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:05.259 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:05.317 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:05.317 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:05.317 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:05.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:05.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:05.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:05.330 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:05.388 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:05.388 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:05.388 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:05.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:06.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:06.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:06.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:06.416 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:06.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:06.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:06.468 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:06.477 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:06.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:06.485 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:06.485 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:06.542 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:06.542 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:06.542 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:06.542 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:06.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:06.557 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:06.557 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:06.614 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:06.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:06.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:06.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:07.543 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:07.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:07.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:07.640 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:07.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:07.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:07.692 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:07.700 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:07.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:07.709 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:07.709 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:07.766 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:07.766 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:07.766 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:07.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:07.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:07.776 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:07.776 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:07.834 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:07.834 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:07.834 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:07.834 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:08.767 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:08.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:08.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:08.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:08.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:08.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:08.918 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:08.927 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:08.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:08.936 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:08.936 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:08.992 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:08.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:08.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:08.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:09.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:09.012 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:09.013 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:09.070 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:09.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:09.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:09.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:09.994 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:09.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:09.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:10.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:10.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:10.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:10.144 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:10.152 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:10.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:10.161 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:10.161 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:10.217 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:10.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:10.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:10.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:10.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:10.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:10.229 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:10.286 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:10.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:10.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:10.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:11.218 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:11.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:11.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:11.315 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:11.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:11.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:11.367 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:11.376 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:11.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:11.384 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:11.385 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:11.441 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:11.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:11.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:11.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:11.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:11.467 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:11.467 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:11.524 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:11.524 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:11.525 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:11.525 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:12.442 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:12.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:12.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:12.540 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:12.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:12.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:12.592 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:12.601 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:12.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:12.610 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:12.610 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:12.666 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:12.667 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:12.667 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:12.667 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:12.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:12.680 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:12.680 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:12.737 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:12.737 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:12.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:12.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:13.667 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:13.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:13.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:13.765 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:13.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:13.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:13.816 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:13.825 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:13.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:13.834 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:13.834 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:13.891 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:13.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:13.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:13.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:13.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:13.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:13.908 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:13.967 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:13.967 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:13.967 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:13.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:14.892 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:14.892 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:14.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:14.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:14.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:14.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:15.042 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:15.051 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:15.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:15.059 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:15.059 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:15.115 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:15.115 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:15.115 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:15.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:15.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:15.130 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:15.130 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:15.187 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:15.187 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:15.187 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:15.187 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:16.116 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:16.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:16.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:16.215 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:16.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:16.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:16.267 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:16.276 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:16.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:16.284 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:16.285 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:16.341 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:16.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:16.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:16.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:16.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:16.361 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:16.361 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:16.418 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:16.418 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:16.418 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:16.418 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:17.343 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:17.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:17.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:17.441 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:17.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:17.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:17.494 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:17.502 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:17.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:17.512 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:17.512 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:17.569 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:17.569 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:17.569 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:17.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:17.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:17.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:17.590 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:17.647 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:17.648 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:17.648 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:17.648 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:18.569 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:18.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:18.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:18.667 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:18.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:18.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:18.720 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:18.729 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:18.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:18.737 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:18.737 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:18.794 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:18.795 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:18.795 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:18.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:18.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:18.805 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:18.806 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:18.864 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:18.864 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:18.864 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:18.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:19.796 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:19.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:19.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:19.894 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:19.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:19.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:19.957 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:19.966 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:19.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:19.975 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:19.975 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:20.032 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:20.032 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:20.032 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:20.032 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:20.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:20.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:20.050 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:20.108 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:20.108 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:20.109 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:20.109 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:21.033 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:07:21.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:21.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:21.131 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:07:21.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:21.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:07:21.182 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-12T22:07:21.191 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-12T22:07:21.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-12T22:07:21.241 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:21.241 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-12T22:07:21.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-12T22:07:21.267 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:07:21.267 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-12T22:07:21.298 INFO:teuthology.orchestra.run.trial126.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:21.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:21.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:21.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:21.299 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:21.301 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:07:21.316 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:07:21.348 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:07:21.349 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:07:21.422 INFO:teuthology.orchestra.run.trial092.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:07:21.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:07:21.422 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:07:21.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:07:21.466 INFO:teuthology.run:FAIL