2026-02-12T22:54:05.571 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:54:05.590 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:54:05.672 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47327 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47327' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - disabled max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true fuse default permissions: false fuse set user groups: true mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded mgr-modules: - snap_schedule sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial013.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3UrvJE4Aj/anzFvBYDmXPM4U+6F+D6VxaqIJRQdgAtIomHiWnZMgQ57kY+Q54vYasJmBC5UmzWhR+uHV0VetI= trial123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOReTzGu1MIa9TGDEIf36GD/8/wike3c70WBXvN6ippgwYFDOpxu+XvECg9nu0p1qB+0SbnJKW9Wo1TdJvDRZo= trial188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCLf7EB7WT4zJHPAunz7WTL7XGxlyB7XqtvNOguZ042ZunhXHWNG8vfKtxgoAU4hGV96KyVUO3Vy4bG1/02VuuE= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:54:05.672 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:54:05.672 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:54:05.673 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:54:05.674 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:54:05.674 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:54:05.674 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:54:05.674 INFO:teuthology.packaging:ref: None 2026-02-12T22:54:05.674 INFO:teuthology.packaging:tag: None 2026-02-12T22:54:05.674 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:54:05.674 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:54:05.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:54:05.812 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:54:05.813 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:54:05.825 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:54:05.825 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:54:05.840 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:54:05.860 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:54:05.872 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:54:05.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial013.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47327', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:50:39.798676', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF3UrvJE4Aj/anzFvBYDmXPM4U+6F+D6VxaqIJRQdgAtIomHiWnZMgQ57kY+Q54vYasJmBC5UmzWhR+uHV0VetI='} 2026-02-12T22:54:06.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial123.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47327', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:50:39.798275', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOReTzGu1MIa9TGDEIf36GD/8/wike3c70WBXvN6ippgwYFDOpxu+XvECg9nu0p1qB+0SbnJKW9Wo1TdJvDRZo='} 2026-02-12T22:54:06.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial188.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47327', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:50:39.797578', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCLf7EB7WT4zJHPAunz7WTL7XGxlyB7XqtvNOguZ042ZunhXHWNG8vfKtxgoAU4hGV96KyVUO3Vy4bG1/02VuuE='} 2026-02-12T22:54:06.089 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:54:06.103 INFO:teuthology.task.internal:roles: ubuntu@trial013.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-12T22:54:06.103 INFO:teuthology.task.internal:roles: ubuntu@trial123.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-12T22:54:06.103 INFO:teuthology.task.internal:roles: ubuntu@trial188.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-12T22:54:06.103 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:54:06.303 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dd0156d56c0>, signals=[15]) 2026-02-12T22:54:06.303 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:54:06.315 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:54:06.315 DEBUG:teuthology.task.internal:connecting to ubuntu@trial013.front.sepia.ceph.com 2026-02-12T22:54:06.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.377 DEBUG:teuthology.task.internal:connecting to ubuntu@trial123.front.sepia.ceph.com 2026-02-12T22:54:06.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.441 DEBUG:teuthology.task.internal:connecting to ubuntu@trial188.front.sepia.ceph.com 2026-02-12T22:54:06.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.500 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:54:06.512 DEBUG:teuthology.orchestra.run.trial013:> uname -m 2026-02-12T22:54:06.527 INFO:teuthology.orchestra.run.trial013.stdout:x86_64 2026-02-12T22:54:06.528 DEBUG:teuthology.orchestra.run.trial013:> cat /etc/os-release 2026-02-12T22:54:06.583 INFO:teuthology.orchestra.run.trial013.stdout:NAME="CentOS Stream" 2026-02-12T22:54:06.583 INFO:teuthology.orchestra.run.trial013.stdout:VERSION="9" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:ID="centos" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:ID_LIKE="rhel fedora" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:VERSION_ID="9" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:PLATFORM_ID="platform:el9" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:ANSI_COLOR="0;31" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:HOME_URL="https://centos.org/" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T22:54:06.584 INFO:teuthology.orchestra.run.trial013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T22:54:06.584 INFO:teuthology.lock.ops:Updating trial013.front.sepia.ceph.com on lock server 2026-02-12T22:54:06.652 DEBUG:teuthology.orchestra.run.trial123:> uname -m 2026-02-12T22:54:06.667 INFO:teuthology.orchestra.run.trial123.stdout:x86_64 2026-02-12T22:54:06.667 DEBUG:teuthology.orchestra.run.trial123:> cat /etc/os-release 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:NAME="CentOS Stream" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:VERSION="9" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:ID="centos" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:ID_LIKE="rhel fedora" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:VERSION_ID="9" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:PLATFORM_ID="platform:el9" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:ANSI_COLOR="0;31" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:HOME_URL="https://centos.org/" 2026-02-12T22:54:06.723 INFO:teuthology.orchestra.run.trial123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T22:54:06.724 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T22:54:06.724 INFO:teuthology.orchestra.run.trial123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T22:54:06.724 INFO:teuthology.lock.ops:Updating trial123.front.sepia.ceph.com on lock server 2026-02-12T22:54:06.798 DEBUG:teuthology.orchestra.run.trial188:> uname -m 2026-02-12T22:54:06.813 INFO:teuthology.orchestra.run.trial188.stdout:x86_64 2026-02-12T22:54:06.813 DEBUG:teuthology.orchestra.run.trial188:> cat /etc/os-release 2026-02-12T22:54:06.870 INFO:teuthology.orchestra.run.trial188.stdout:NAME="CentOS Stream" 2026-02-12T22:54:06.870 INFO:teuthology.orchestra.run.trial188.stdout:VERSION="9" 2026-02-12T22:54:06.870 INFO:teuthology.orchestra.run.trial188.stdout:ID="centos" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:ID_LIKE="rhel fedora" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:VERSION_ID="9" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:PLATFORM_ID="platform:el9" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:ANSI_COLOR="0;31" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:HOME_URL="https://centos.org/" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T22:54:06.871 INFO:teuthology.orchestra.run.trial188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T22:54:06.871 INFO:teuthology.lock.ops:Updating trial188.front.sepia.ceph.com on lock server 2026-02-12T22:54:06.953 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:54:06.967 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:54:06.978 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:54:06.979 DEBUG:teuthology.orchestra.run.trial013:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:54:06.980 DEBUG:teuthology.orchestra.run.trial123:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:54:06.982 DEBUG:teuthology.orchestra.run.trial188:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:54:06.997 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:54:07.008 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:54:07.009 DEBUG:teuthology.orchestra.run.trial013:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:54:07.035 DEBUG:teuthology.orchestra.run.trial123:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:54:07.038 DEBUG:teuthology.orchestra.run.trial188:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:54:07.054 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:54:07.277 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:54:07.296 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:54:07.296 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}, 'mon.c': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:54:07.296 DEBUG:teuthology.orchestra.run.trial013:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:54:07.296 DEBUG:teuthology.orchestra.run.trial123:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:54:07.296 DEBUG:teuthology.orchestra.run.trial188:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:54:07.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:54:07.311 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:54:07.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:54:07.311 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:54:07.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:54:07.311 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:54:07.366 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:54:07.366 INFO:teuthology.task.kernel:Running kernel on trial123: 5.14.0-645.el9.x86_64 2026-02-12T22:54:07.366 DEBUG:teuthology.orchestra.run.trial123:> sudo yum install -y kernel 2026-02-12T22:54:07.367 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:54:07.367 INFO:teuthology.task.kernel:Running kernel on trial188: 5.14.0-645.el9.x86_64 2026-02-12T22:54:07.367 DEBUG:teuthology.orchestra.run.trial188:> sudo yum install -y kernel 2026-02-12T22:54:07.368 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:54:07.368 INFO:teuthology.task.kernel:Running kernel on trial013: 5.14.0-645.el9.x86_64 2026-02-12T22:54:07.368 DEBUG:teuthology.orchestra.run.trial013:> sudo yum install -y kernel 2026-02-12T22:54:08.435 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T22:54:08.502 INFO:teuthology.orchestra.run.trial013.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-12T22:54:11.469 INFO:teuthology.orchestra.run.trial013.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T22:54:11.480 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T22:54:15.557 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 7.8 MB 00:01 2026-02-12T22:54:16.086 INFO:teuthology.orchestra.run.trial013.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 7.8 MB 00:02 2026-02-12T22:54:16.500 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-12T22:54:17.119 INFO:teuthology.orchestra.run.trial013.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 20 kB 00:00 2026-02-12T22:54:17.433 INFO:teuthology.orchestra.run.trial013.stdout:Extra Packages for Enterprise Linux 84 MB/s | 20 MB 00:00 2026-02-12T22:54:17.530 INFO:teuthology.orchestra.run.trial188.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-12T22:54:18.431 INFO:teuthology.orchestra.run.trial188.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-12T22:54:19.911 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-12T22:54:20.675 INFO:teuthology.orchestra.run.trial013.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-12T22:54:21.675 INFO:teuthology.orchestra.run.trial188.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T22:54:21.729 INFO:teuthology.orchestra.run.trial013.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T22:54:21.749 INFO:teuthology.orchestra.run.trial013.stdout:Dependencies resolved. 2026-02-12T22:54:21.750 INFO:teuthology.orchestra.run.trial013.stdout:================================================================================ 2026-02-12T22:54:21.750 INFO:teuthology.orchestra.run.trial013.stdout: Package Architecture Version Repository Size 2026-02-12T22:54:21.750 INFO:teuthology.orchestra.run.trial013.stdout:================================================================================ 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout:Installing: 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout:Installing dependencies: 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout:Transaction Summary 2026-02-12T22:54:21.751 INFO:teuthology.orchestra.run.trial013.stdout:================================================================================ 2026-02-12T22:54:21.752 INFO:teuthology.orchestra.run.trial013.stdout:Install 4 Packages 2026-02-12T22:54:21.752 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:54:21.752 INFO:teuthology.orchestra.run.trial013.stdout:Total download size: 88 M 2026-02-12T22:54:21.752 INFO:teuthology.orchestra.run.trial013.stdout:Installed size: 135 M 2026-02-12T22:54:21.752 INFO:teuthology.orchestra.run.trial013.stdout:Downloading Packages: 2026-02-12T22:54:22.744 INFO:teuthology.orchestra.run.trial188.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T22:54:22.764 INFO:teuthology.orchestra.run.trial188.stdout:Dependencies resolved. 2026-02-12T22:54:22.765 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-12T22:54:22.765 INFO:teuthology.orchestra.run.trial188.stdout: Package Architecture Version Repository Size 2026-02-12T22:54:22.765 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-12T22:54:22.765 INFO:teuthology.orchestra.run.trial188.stdout:Installing: 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout:Installing dependencies: 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout:Transaction Summary 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout:================================================================================ 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout:Install 4 Packages 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-12T22:54:22.766 INFO:teuthology.orchestra.run.trial188.stdout:Total download size: 88 M 2026-02-12T22:54:22.767 INFO:teuthology.orchestra.run.trial188.stdout:Installed size: 135 M 2026-02-12T22:54:22.767 INFO:teuthology.orchestra.run.trial188.stdout:Downloading Packages: 2026-02-12T22:54:22.922 INFO:teuthology.orchestra.run.trial188.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 11 MB/s | 768 kB 00:00 2026-02-12T22:54:23.319 INFO:teuthology.orchestra.run.trial188.stdout:(2/4): kernel-modules-core-5.14.0-677.el9.x86_6 78 MB/s | 31 MB 00:00 2026-02-12T22:54:23.524 INFO:teuthology.orchestra.run.trial013.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 533 kB/s | 768 kB 00:01 2026-02-12T22:54:23.715 INFO:teuthology.orchestra.run.trial188.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 46 MB/s | 40 MB 00:00 2026-02-12T22:54:23.799 INFO:teuthology.orchestra.run.trial188.stdout:(4/4): kernel-core-5.14.0-677.el9.x86_64.rpm 18 MB/s | 17 MB 00:00 2026-02-12T22:54:23.799 INFO:teuthology.orchestra.run.trial188.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:54:23.799 INFO:teuthology.orchestra.run.trial188.stdout:Total 85 MB/s | 88 MB 00:01 2026-02-12T22:54:23.987 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction check 2026-02-12T22:54:24.189 INFO:teuthology.orchestra.run.trial188.stdout:Transaction check succeeded. 2026-02-12T22:54:24.189 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction test 2026-02-12T22:54:24.535 INFO:teuthology.orchestra.run.trial188.stdout:Transaction test succeeded. 2026-02-12T22:54:24.535 INFO:teuthology.orchestra.run.trial188.stdout:Running transaction 2026-02-12T22:54:25.628 INFO:teuthology.orchestra.run.trial188.stdout: Preparing : 1/1 2026-02-12T22:54:25.912 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T22:54:25.931 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:54:27.704 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:54:27.733 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:54:30.229 INFO:teuthology.orchestra.run.trial013.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 2.1 MB/s | 17 MB 00:08 2026-02-12T22:54:30.765 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:54:30.772 INFO:teuthology.orchestra.run.trial188.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:54:31.006 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - CRB 908 kB/s | 7.8 MB 00:08 2026-02-12T22:54:31.596 INFO:teuthology.orchestra.run.trial013.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 3.8 MB/s | 31 MB 00:08 2026-02-12T22:54:31.901 INFO:teuthology.orchestra.run.trial123.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 20 kB 00:00 2026-02-12T22:54:32.766 INFO:teuthology.orchestra.run.trial123.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-12T22:54:33.808 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:54:35.925 INFO:teuthology.orchestra.run.trial123.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T22:54:36.996 INFO:teuthology.orchestra.run.trial123.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T22:54:37.016 INFO:teuthology.orchestra.run.trial123.stdout:Dependencies resolved. 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout: Package Architecture Version Repository Size 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout:Installing: 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout:Installing dependencies: 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T22:54:37.017 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout:Transaction Summary 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout:================================================================================ 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout:Install 4 Packages 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout:Total download size: 88 M 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout:Installed size: 135 M 2026-02-12T22:54:37.018 INFO:teuthology.orchestra.run.trial123.stdout:Downloading Packages: 2026-02-12T22:54:37.297 INFO:teuthology.orchestra.run.trial123.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 3.8 MB/s | 768 kB 00:00 2026-02-12T22:54:37.459 INFO:teuthology.orchestra.run.trial123.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 47 MB/s | 17 MB 00:00 2026-02-12T22:54:37.636 INFO:teuthology.orchestra.run.trial123.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 91 MB/s | 31 MB 00:00 2026-02-12T22:54:37.713 INFO:teuthology.orchestra.run.trial123.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 65 MB/s | 40 MB 00:00 2026-02-12T22:54:37.713 INFO:teuthology.orchestra.run.trial123.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:54:37.714 INFO:teuthology.orchestra.run.trial123.stdout:Total 127 MB/s | 88 MB 00:00 2026-02-12T22:54:37.901 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction check 2026-02-12T22:54:38.105 INFO:teuthology.orchestra.run.trial123.stdout:Transaction check succeeded. 2026-02-12T22:54:38.105 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction test 2026-02-12T22:54:38.451 INFO:teuthology.orchestra.run.trial123.stdout:Transaction test succeeded. 2026-02-12T22:54:38.451 INFO:teuthology.orchestra.run.trial123.stdout:Running transaction 2026-02-12T22:54:39.545 INFO:teuthology.orchestra.run.trial123.stdout: Preparing : 1/1 2026-02-12T22:54:39.830 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T22:54:39.849 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:54:41.619 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:54:41.649 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:54:44.883 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:54:44.889 INFO:teuthology.orchestra.run.trial123.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:54:47.991 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:04.381 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:04.403 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:04.467 INFO:teuthology.orchestra.run.trial188.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:04.467 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T22:55:04.468 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:55:04.468 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:55:04.519 INFO:teuthology.orchestra.run.trial188.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:04.519 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-12T22:55:04.519 INFO:teuthology.orchestra.run.trial188.stdout:Installed: 2026-02-12T22:55:04.520 INFO:teuthology.orchestra.run.trial188.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:04.520 INFO:teuthology.orchestra.run.trial188.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T22:55:04.520 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T22:55:04.520 INFO:teuthology.orchestra.run.trial188.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T22:55:04.520 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-12T22:55:04.520 INFO:teuthology.orchestra.run.trial188.stdout:Complete! 2026-02-12T22:55:04.578 DEBUG:teuthology.orchestra.run.trial188:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:55:04.604 INFO:teuthology.orchestra.run.trial188.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:04.605 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T22:55:04.605 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T22:55:04.605 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:55:04.605 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:55:04.606 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-12T22:55:04.606 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial188.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:55:04.606 DEBUG:teuthology.orchestra.run.trial188:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:55:04.669 INFO:teuthology.orchestra.run.trial188.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:04.671 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T22:55:04.671 DEBUG:teuthology.orchestra.run.trial188:> sudo rpm -qi grub2-tools 2026-02-12T22:55:04.741 INFO:teuthology.orchestra.run.trial188.stdout:Name : grub2-tools 2026-02-12T22:55:04.741 INFO:teuthology.orchestra.run.trial188.stdout:Epoch : 1 2026-02-12T22:55:04.741 INFO:teuthology.orchestra.run.trial188.stdout:Version : 2.06 2026-02-12T22:55:04.741 INFO:teuthology.orchestra.run.trial188.stdout:Release : 118.el9 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Architecture: x86_64 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Group : Unspecified 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Size : 8393909 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:License : GPLv3+ 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Packager : builder@centos.org 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Vendor : CentOS 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:55:04.742 INFO:teuthology.orchestra.run.trial188.stdout:Summary : Support tools for GRUB. 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout:Description : 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout:hardware devices. 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout: 2026-02-12T22:55:04.743 INFO:teuthology.orchestra.run.trial188.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:55:04.744 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:55:04.744 INFO:teuthology.task.kernel:Updating grub on trial188 to boot 5.14.0-677.el9.x86_64 2026-02-12T22:55:04.745 DEBUG:teuthology.orchestra.run.trial188:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:55:04.809 INFO:teuthology.orchestra.run.trial188.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T22:55:04.811 DEBUG:teuthology.orchestra.run.trial188:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:55:04.874 INFO:teuthology.orchestra.run.trial188.stdout:/sbin/grubby 2026-02-12T22:55:04.876 INFO:teuthology.orchestra.run.trial188.stdout:yes 2026-02-12T22:55:04.876 DEBUG:teuthology.orchestra.run.trial188:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T22:55:04.940 INFO:teuthology.orchestra.run.trial188.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T22:55:04.941 DEBUG:teuthology.orchestra.run.trial188:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T22:55:05.015 DEBUG:teuthology.orchestra.run.trial188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:55:05.227 INFO:teuthology.orchestra.run.trial188.stderr:Generating grub configuration file ... 2026-02-12T22:55:05.289 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T22:55:05.296 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T22:55:05.546 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T22:55:05.552 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T22:55:05.584 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T22:55:05.590 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T22:55:05.615 INFO:teuthology.orchestra.run.trial188.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T22:55:05.622 INFO:teuthology.orchestra.run.trial188.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T22:55:05.705 INFO:teuthology.orchestra.run.trial188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:55:05.713 INFO:teuthology.orchestra.run.trial188.stderr:done 2026-02-12T22:55:05.715 DEBUG:teuthology.orchestra.run.trial188:> test -d /sys/firmware/efi 2026-02-12T22:55:05.731 DEBUG:teuthology.orchestra.run.trial188:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:55:05.796 INFO:teuthology.orchestra.run.trial188.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:55:05.796 INFO:teuthology.orchestra.run.trial188.stdout:/boot/efi/EFI/centos 2026-02-12T22:55:05.798 DEBUG:teuthology.orchestra.run.trial188:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:55:05.864 INFO:teuthology.orchestra.run.trial188.stdout:no 2026-02-12T22:55:05.864 DEBUG:teuthology.orchestra.run.trial188:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T22:55:05.928 INFO:teuthology.orchestra.run.trial188.stdout:yes 2026-02-12T22:55:05.928 DEBUG:teuthology.orchestra.run.trial188:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T22:55:05.991 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial188 2026-02-12T22:55:05.992 DEBUG:teuthology.orchestra.run.trial188:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:55:06.054 INFO:teuthology.orchestra.run.trial188.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:55:07.980 INFO:teuthology.orchestra.run.trial013.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 884 kB/s | 40 MB 00:45 2026-02-12T22:55:07.981 INFO:teuthology.orchestra.run.trial013.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:55:07.981 INFO:teuthology.orchestra.run.trial013.stdout:Total 1.9 MB/s | 88 MB 00:46 2026-02-12T22:55:08.171 INFO:teuthology.orchestra.run.trial013.stdout:Running transaction check 2026-02-12T22:55:08.369 INFO:teuthology.orchestra.run.trial013.stdout:Transaction check succeeded. 2026-02-12T22:55:08.370 INFO:teuthology.orchestra.run.trial013.stdout:Running transaction test 2026-02-12T22:55:08.714 INFO:teuthology.orchestra.run.trial013.stdout:Transaction test succeeded. 2026-02-12T22:55:08.715 INFO:teuthology.orchestra.run.trial013.stdout:Running transaction 2026-02-12T22:55:09.818 INFO:teuthology.orchestra.run.trial013.stdout: Preparing : 1/1 2026-02-12T22:55:10.106 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T22:55:10.125 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:55:11.884 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:55:11.912 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:55:14.929 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:55:14.935 INFO:teuthology.orchestra.run.trial013.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:17.962 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:18.493 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:18.515 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:18.579 INFO:teuthology.orchestra.run.trial123.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:18.579 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T22:55:18.579 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:55:18.579 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:55:18.631 INFO:teuthology.orchestra.run.trial123.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:18.631 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout:Installed: 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:55:18.632 INFO:teuthology.orchestra.run.trial123.stdout:Complete! 2026-02-12T22:55:18.693 DEBUG:teuthology.orchestra.run.trial123:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:55:18.760 INFO:teuthology.orchestra.run.trial123.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:18.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T22:55:18.761 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T22:55:18.761 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:55:18.761 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:55:18.761 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:55:18.761 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial123.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:55:18.762 DEBUG:teuthology.orchestra.run.trial123:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:55:18.824 INFO:teuthology.orchestra.run.trial123.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:18.824 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T22:55:18.825 DEBUG:teuthology.orchestra.run.trial123:> sudo rpm -qi grub2-tools 2026-02-12T22:55:18.894 INFO:teuthology.orchestra.run.trial123.stdout:Name : grub2-tools 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Epoch : 1 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Version : 2.06 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Release : 118.el9 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Architecture: x86_64 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Group : Unspecified 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Size : 8393909 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:License : GPLv3+ 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Packager : builder@centos.org 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Vendor : CentOS 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Summary : Support tools for GRUB. 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout:Description : 2026-02-12T22:55:18.895 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:55:18.896 INFO:teuthology.orchestra.run.trial123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:55:18.896 INFO:teuthology.orchestra.run.trial123.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:55:18.896 INFO:teuthology.orchestra.run.trial123.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:55:18.896 INFO:teuthology.orchestra.run.trial123.stdout:hardware devices. 2026-02-12T22:55:18.896 INFO:teuthology.orchestra.run.trial123.stdout: 2026-02-12T22:55:18.896 INFO:teuthology.orchestra.run.trial123.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:55:18.896 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:55:18.896 INFO:teuthology.task.kernel:Updating grub on trial123 to boot 5.14.0-677.el9.x86_64 2026-02-12T22:55:18.896 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:55:18.959 INFO:teuthology.orchestra.run.trial123.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T22:55:18.960 DEBUG:teuthology.orchestra.run.trial123:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:55:19.024 INFO:teuthology.orchestra.run.trial123.stdout:/sbin/grubby 2026-02-12T22:55:19.025 INFO:teuthology.orchestra.run.trial123.stdout:yes 2026-02-12T22:55:19.026 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T22:55:19.092 INFO:teuthology.orchestra.run.trial123.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T22:55:19.093 DEBUG:teuthology.orchestra.run.trial123:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T22:55:19.165 DEBUG:teuthology.orchestra.run.trial123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:55:19.373 INFO:teuthology.orchestra.run.trial123.stderr:Generating grub configuration file ... 2026-02-12T22:55:19.437 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T22:55:19.443 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T22:55:19.697 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T22:55:19.704 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T22:55:19.734 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T22:55:19.740 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T22:55:19.763 INFO:teuthology.orchestra.run.trial123.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T22:55:19.769 INFO:teuthology.orchestra.run.trial123.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T22:55:19.851 INFO:teuthology.orchestra.run.trial123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:55:19.859 INFO:teuthology.orchestra.run.trial123.stderr:done 2026-02-12T22:55:19.861 DEBUG:teuthology.orchestra.run.trial123:> test -d /sys/firmware/efi 2026-02-12T22:55:19.877 DEBUG:teuthology.orchestra.run.trial123:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:55:19.942 INFO:teuthology.orchestra.run.trial123.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:55:19.942 INFO:teuthology.orchestra.run.trial123.stdout:/boot/efi/EFI/centos 2026-02-12T22:55:19.944 DEBUG:teuthology.orchestra.run.trial123:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:55:20.010 INFO:teuthology.orchestra.run.trial123.stdout:no 2026-02-12T22:55:20.010 DEBUG:teuthology.orchestra.run.trial123:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T22:55:20.077 INFO:teuthology.orchestra.run.trial123.stdout:yes 2026-02-12T22:55:20.077 DEBUG:teuthology.orchestra.run.trial123:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T22:55:20.141 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial123 2026-02-12T22:55:20.142 DEBUG:teuthology.orchestra.run.trial123:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:55:20.204 INFO:teuthology.orchestra.run.trial123.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:55:36.034 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:36.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:36.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:36.147 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:36.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:36.222 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:36.222 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:36.279 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:36.280 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:36.280 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:36.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:37.283 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:37.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:37.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:37.391 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:37.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:37.463 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:37.463 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:37.519 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:37.520 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:37.520 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:37.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.522 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:38.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:38.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.632 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:38.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:38.707 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:38.707 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:38.764 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:38.765 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:38.765 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:38.765 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.766 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:39.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:39.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.874 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:39.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:39.950 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:39.950 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:40.005 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:40.006 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:40.006 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:40.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:41.007 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:41.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:41.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:41.117 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:41.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:41.194 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:41.194 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:41.250 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:41.251 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:41.251 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:41.251 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:42.252 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:42.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:42.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:42.361 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:42.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:42.436 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:42.436 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:42.491 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:42.492 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:42.492 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:42.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.493 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:43.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:43.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.604 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:43.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:43.679 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:43.680 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:43.734 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:43.735 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:43.735 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:43.735 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.736 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:44.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:44.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.851 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:44.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:44.925 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:44.925 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:44.980 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:44.981 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:44.981 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:44.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:45.982 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:45.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:45.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:46.091 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:46.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:46.164 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:46.164 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:46.222 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:46.223 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:46.223 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:46.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.224 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:47.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:47.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.331 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:47.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:47.405 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:47.405 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:47.461 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:47.461 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:47.461 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:47.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.271 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:48.292 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:48.355 INFO:teuthology.orchestra.run.trial013.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:48.355 INFO:teuthology.orchestra.run.trial013.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T22:55:48.355 INFO:teuthology.orchestra.run.trial013.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T22:55:48.355 INFO:teuthology.orchestra.run.trial013.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout:Installed: 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.407 INFO:teuthology.orchestra.run.trial013.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.408 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:55:48.408 INFO:teuthology.orchestra.run.trial013.stdout:Complete! 2026-02-12T22:55:48.463 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:48.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:48.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.467 DEBUG:teuthology.orchestra.run.trial013:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:55:48.560 INFO:teuthology.orchestra.run.trial013.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.560 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T22:55:48.560 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T22:55:48.560 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:55:48.560 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:55:48.560 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:55:48.560 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial013.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:55:48.560 DEBUG:teuthology.orchestra.run.trial013:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:55:48.570 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:48.624 INFO:teuthology.orchestra.run.trial013.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.624 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T22:55:48.624 DEBUG:teuthology.orchestra.run.trial013:> sudo rpm -qi grub2-tools 2026-02-12T22:55:48.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:48.644 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:48.644 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:48.692 INFO:teuthology.orchestra.run.trial013.stdout:Name : grub2-tools 2026-02-12T22:55:48.692 INFO:teuthology.orchestra.run.trial013.stdout:Epoch : 1 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Version : 2.06 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Release : 118.el9 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Architecture: x86_64 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Group : Unspecified 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Size : 8393909 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:License : GPLv3+ 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Packager : builder@centos.org 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Vendor : CentOS 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Summary : Support tools for GRUB. 2026-02-12T22:55:48.693 INFO:teuthology.orchestra.run.trial013.stdout:Description : 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout:hardware devices. 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout: 2026-02-12T22:55:48.694 INFO:teuthology.orchestra.run.trial013.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:55:48.695 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:55:48.695 INFO:teuthology.task.kernel:Updating grub on trial013 to boot 5.14.0-677.el9.x86_64 2026-02-12T22:55:48.695 DEBUG:teuthology.orchestra.run.trial013:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:55:48.699 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:48.700 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:48.700 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:48.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.758 INFO:teuthology.orchestra.run.trial013.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T22:55:48.759 DEBUG:teuthology.orchestra.run.trial013:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:55:48.823 INFO:teuthology.orchestra.run.trial013.stdout:/sbin/grubby 2026-02-12T22:55:48.824 INFO:teuthology.orchestra.run.trial013.stdout:yes 2026-02-12T22:55:48.825 DEBUG:teuthology.orchestra.run.trial013:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T22:55:48.889 INFO:teuthology.orchestra.run.trial013.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T22:55:48.890 DEBUG:teuthology.orchestra.run.trial013:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T22:55:48.962 DEBUG:teuthology.orchestra.run.trial013:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:55:49.172 INFO:teuthology.orchestra.run.trial013.stderr:Generating grub configuration file ... 2026-02-12T22:55:49.236 INFO:teuthology.orchestra.run.trial013.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T22:55:49.242 INFO:teuthology.orchestra.run.trial013.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T22:55:49.495 INFO:teuthology.orchestra.run.trial013.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T22:55:49.501 INFO:teuthology.orchestra.run.trial013.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T22:55:49.533 INFO:teuthology.orchestra.run.trial013.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T22:55:49.540 INFO:teuthology.orchestra.run.trial013.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T22:55:49.563 INFO:teuthology.orchestra.run.trial013.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T22:55:49.569 INFO:teuthology.orchestra.run.trial013.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T22:55:49.651 INFO:teuthology.orchestra.run.trial013.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:55:49.660 INFO:teuthology.orchestra.run.trial013.stderr:done 2026-02-12T22:55:49.662 DEBUG:teuthology.orchestra.run.trial013:> test -d /sys/firmware/efi 2026-02-12T22:55:49.678 DEBUG:teuthology.orchestra.run.trial013:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:55:49.701 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:49.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:49.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.808 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:49.825 INFO:teuthology.orchestra.run.trial013.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:55:49.825 INFO:teuthology.orchestra.run.trial013.stdout:/boot/efi/EFI/centos 2026-02-12T22:55:49.827 DEBUG:teuthology.orchestra.run.trial013:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:55:49.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:49.885 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:49.885 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:49.891 INFO:teuthology.orchestra.run.trial013.stdout:no 2026-02-12T22:55:49.891 DEBUG:teuthology.orchestra.run.trial013:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T22:55:49.940 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:49.941 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:49.941 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:49.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.957 INFO:teuthology.orchestra.run.trial013.stdout:yes 2026-02-12T22:55:49.958 DEBUG:teuthology.orchestra.run.trial013:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T22:55:50.021 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial013 2026-02-12T22:55:50.022 DEBUG:teuthology.orchestra.run.trial013:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:55:50.085 INFO:teuthology.orchestra.run.trial013.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:55:50.185 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:50.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:50.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.298 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:50.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:50.374 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:50.374 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:50.430 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:50.430 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:50.430 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:50.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:50.942 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:50.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:50.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:51.050 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:51.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:51.128 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:51.129 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:51.184 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:51.185 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:51.185 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:51.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.431 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:51.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:51.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:51.544 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:51.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:51.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:51.616 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:51.671 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:51.671 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:51.672 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:51.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.187 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:52.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:52.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.296 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:52.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:52.370 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:52.370 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:52.428 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:52.428 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:52.429 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:52.429 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.673 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:52.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:52.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.784 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:52.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:52.859 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:52.859 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:52.914 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:52.915 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:52.915 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:52.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.430 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:53.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:53.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.509 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:53.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:53.579 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:53.579 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:53.634 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:53.634 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:53.634 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:53.634 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.916 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:53.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:53.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.028 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:54.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:54.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:54.101 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:54.156 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:54.157 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:54.157 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:54.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.634 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:54.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:54.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.745 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:54.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:54.825 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:54.825 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:54.881 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:54.882 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:54.882 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:54.882 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:55.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:55.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:55.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.270 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:55.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:55.344 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:55.344 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:55.400 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:55.401 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:55.401 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:55.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:55.883 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:55.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:55.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:55.991 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:56.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:56.063 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:56.063 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:56.118 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:56.119 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:56.119 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:56.119 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:56.403 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:56.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:56.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:56.515 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:56.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:56.593 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:56.593 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:56.648 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:56.649 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:56.649 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:56.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.120 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:57.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:57.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.228 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:57.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:57.301 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:57.301 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:57.356 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:57.357 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:57.357 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:57.357 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.650 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:57.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:57.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.764 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:57.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:57.837 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:57.837 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:57.894 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:57.894 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:57.894 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:57.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.358 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:58.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:58.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.466 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:58.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:58.541 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:58.541 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:58.598 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:58.599 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:58.599 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:58.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.896 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:58.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:58.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.006 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:55:59.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:55:59.098 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:59.098 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:55:59.156 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:59.157 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:59.157 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:59.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:59.601 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:55:59.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:59.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:59.708 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:55:59.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:55:59.786 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:55:59.786 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:55:59.842 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:55:59.843 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:55:59.843 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:55:59.843 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:00.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:00.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:00.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:00.269 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:00.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:00.341 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:00.341 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:00.396 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:00.397 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:00.397 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:00.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:00.844 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:00.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:00.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:00.993 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:01.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:01.066 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:01.067 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:01.122 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:01.123 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:01.123 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:01.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:01.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:01.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:01.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:01.507 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:01.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:01.583 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:01.583 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:01.639 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:01.639 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:01.639 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:01.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.124 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:02.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:02.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.233 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:02.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:02.308 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:02.308 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:02.364 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:02.364 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:02.364 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:02.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:02.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:02.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:02.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:02.755 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:02.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:02.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:02.831 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:02.889 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:02.889 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:02.889 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:02.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.365 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:03.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:03.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:03.473 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:03.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:03.548 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:03.548 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:03.603 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:03.604 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:03.604 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:03.604 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:03.890 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:03.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:03.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.003 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:04.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:04.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:04.073 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:04.129 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:04.129 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:04.129 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:04.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:04.605 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:04.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:04.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:04.712 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:04.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:04.784 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:04.784 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:04.840 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:04.840 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:04.840 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:04.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:05.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:05.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:05.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.242 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:05.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:05.318 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:05.318 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:05.375 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:05.375 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:05.376 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:05.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:05.842 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:05.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:05.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:05.902 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:05.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:05.976 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:05.976 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:06.032 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:06.032 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:06.032 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:06.032 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:06.377 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:06.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:06.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:06.495 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:06.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:06.566 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:06.566 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:06.622 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:06.622 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:06.623 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:06.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.034 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:07.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:07.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.163 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:07.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:07.238 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:07.238 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:07.294 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:07.294 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:07.295 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:07.295 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:07.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:07.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:07.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:07.736 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:07.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:07.819 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:07.819 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:07.876 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:07.877 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:07.877 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:07.877 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.296 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:08.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:08.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.404 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:08.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:08.481 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:08.481 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:08.539 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:08.539 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:08.539 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:08.539 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:08.878 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:08.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:08.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:08.988 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:09.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:09.059 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:09.059 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:09.115 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:09.115 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:09.115 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:09.115 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:09.540 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:09.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:09.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:09.648 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:09.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:09.727 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:09.727 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:09.783 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:09.784 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:09.784 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:09.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:10.116 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:10.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:10.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.229 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:10.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:10.305 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:10.306 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:10.361 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:10.361 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:10.361 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:10.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:10.785 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:10.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:10.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:10.892 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:10.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:10.967 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:10.967 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:11.023 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:11.023 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:11.024 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:11.024 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:11.363 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:11.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:11.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:11.474 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:11.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:11.544 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:11.544 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:11.600 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:11.601 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:11.601 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:11.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.025 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:12.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:12.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.133 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:12.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:12.206 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:12.206 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:12.262 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:12.262 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:12.262 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:12.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:12.603 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:12.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:12.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:12.715 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:12.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:12.785 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:12.785 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:12.841 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:12.842 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:12.842 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:12.842 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.264 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:13.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:13.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.373 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:13.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:13.448 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:13.448 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:13.504 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:13.504 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:13.504 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:13.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:13.843 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:13.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:13.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:13.954 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:14.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:14.028 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:14.028 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:14.084 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:14.085 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:14.085 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:14.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:14.506 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:14.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:14.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:14.635 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:14.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:14.711 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:14.711 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:14.766 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:14.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:14.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:14.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:15.086 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:15.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:15.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.197 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:15.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:15.273 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:15.273 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:15.331 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:15.331 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:15.331 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:15.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:15.767 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:15.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:15.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:15.876 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:15.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:15.949 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:15.950 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:16.005 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:16.006 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:16.006 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:16.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:16.333 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:16.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:16.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:16.444 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:16.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:16.513 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:16.513 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:16.571 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:16.571 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:16.572 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:16.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.006 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:17.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:17.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.119 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:17.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:17.195 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:17.195 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:17.252 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:17.252 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:17.252 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:17.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:17.573 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:17.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:17.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:17.672 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:17.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:17.751 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:17.752 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:17.807 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:17.808 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:17.808 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:17.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.254 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:18.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:18.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.362 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:18.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:18.435 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:18.435 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:18.491 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:18.491 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:18.491 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:18.492 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:18.809 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:18.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:18.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:18.921 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:18.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:18.998 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:18.998 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:19.053 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:19.054 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:19.054 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:19.054 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:19.492 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:19.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:19.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:19.597 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:19.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:19.667 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:19.667 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:19.723 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:19.723 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:19.723 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:19.723 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:20.056 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:20.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:20.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.064 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:20.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:20.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.168 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:20.265 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:20.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:20.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:20.270 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:20.326 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:20.326 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:20.326 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:20.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:20.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:20.337 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:20.337 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:20.393 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:20.394 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:20.394 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:20.394 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:20.724 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:20.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:20.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:20.835 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:20.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:20.913 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:20.913 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:20.971 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:20.971 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:20.971 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:20.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.327 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:21.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:21.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:21.425 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:21.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:21.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:21.478 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:21.488 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:21.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:21.535 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:21.535 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:21.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:21.566 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:21.566 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:21.591 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:21.591 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:21.592 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:21.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.623 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:21.624 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:21.624 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:21.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:21.973 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:21.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:21.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.049 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:22.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:22.124 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:22.124 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:22.179 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:22.180 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:22.180 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:22.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.593 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:22.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:22.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.691 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:22.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:22.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:22.743 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:22.755 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:22.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:22.801 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:22.801 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:22.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:22.832 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:22.832 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:22.857 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:22.857 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:22.857 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:22.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:22.887 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:22.887 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:22.887 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:22.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.181 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:23.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:23.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.285 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:23.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:23.359 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:23.359 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:23.415 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:23.415 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:23.415 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:23.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:23.858 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:23.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:23.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:23.957 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:23.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:23.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.010 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:24.021 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:24.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:24.067 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:24.067 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:24.094 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:24.094 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:24.094 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:24.124 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:24.124 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:24.124 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:24.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.149 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:24.149 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:24.149 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:24.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:24.417 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:24.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:24.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:24.525 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:24.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:24.595 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:24.595 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:24.650 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:24.651 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:24.651 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:24.651 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:25.126 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:25.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:25.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:25.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:25.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.278 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:25.289 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:25.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:25.336 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:25.336 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:25.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:25.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:25.364 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:25.391 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:25.391 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:25.391 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:25.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:25.421 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:25.422 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:25.422 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:25.422 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:25.652 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:25.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:25.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:25.746 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:25.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:25.818 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:25.819 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:25.875 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:25.876 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:25.876 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:25.876 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.393 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:26.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:26.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.491 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:26.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:26.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.544 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:26.555 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:26.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:26.601 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:26.601 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:26.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:26.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:26.629 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:26.657 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:26.657 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:26.657 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:26.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.684 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:26.685 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:26.685 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:26.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:26.877 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:26.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:26.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:26.985 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:27.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:27.065 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:27.065 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:27.121 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:27.122 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:27.122 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:27.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.659 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:27.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:27.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:27.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:27.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:27.810 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:27.821 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:27.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:27.868 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:27.868 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:27.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:27.898 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:27.898 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:27.924 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:27.924 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:27.925 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:27.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:27.956 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:27.956 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:27.956 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:27.956 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.124 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:28.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:28.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:28.232 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:28.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:28.304 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:28.305 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:28.361 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:28.361 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:28.362 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:28.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:28.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:28.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:28.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.026 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:29.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:29.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.079 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:29.090 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:29.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:29.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:29.137 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:29.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:29.164 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:29.164 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:29.194 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:29.194 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:29.194 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:29.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.222 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:29.222 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:29.223 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:29.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:29.363 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:29.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:29.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:29.470 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:29.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:29.548 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:29.548 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:29.604 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:29.604 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:29.605 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:29.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:30.196 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:30.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:30.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:30.294 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:30.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:30.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:30.347 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:30.358 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:30.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:30.404 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:30.405 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:30.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:30.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:30.430 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:30.461 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:30.461 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:30.461 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:30.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:30.485 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:30.485 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:30.486 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:30.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:30.606 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:30.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:30.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:30.712 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:30.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:30.784 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:30.784 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:30.839 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:30.840 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:30.840 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:30.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.462 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:31.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:31.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.519 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:31.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:31.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.571 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:31.582 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:31.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:31.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:31.627 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:31.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:31.655 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:31.655 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:31.683 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:31.683 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:31.683 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:31.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.712 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:31.712 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:31.712 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:31.712 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:31.841 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:31.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:31.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:31.948 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:32.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:32.026 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:32.026 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:32.081 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:32.082 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:32.082 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:32.082 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.684 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:32.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:32.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.783 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:32.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:32.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:32.835 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:32.846 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:32.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:32.893 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:32.893 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:32.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:32.922 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:32.922 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:32.950 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:32.950 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:32.950 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:32.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:32.978 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:32.978 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:32.978 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:32.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.083 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:33.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:33.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:33.189 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:33.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:33.269 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:33.269 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:33.324 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:33.324 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:33.325 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:33.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:33.952 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:33.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:33.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.050 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:34.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:34.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.103 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:34.114 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:34.160 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:34.160 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:34.160 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:34.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:34.186 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:34.186 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:34.216 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:34.216 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:34.216 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:34.216 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.241 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:34.242 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:34.242 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:34.242 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:34.326 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:34.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:34.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:34.435 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:34.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:34.506 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:34.506 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:34.561 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:34.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:34.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:34.562 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.217 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:35.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:35.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:35.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:35.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:35.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:35.368 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:35.379 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:35.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:35.425 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:35.425 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:35.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:35.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:35.463 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:35.480 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:35.480 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:35.480 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:35.481 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.519 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:35.519 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:35.520 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:35.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:35.564 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:35.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:35.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:35.672 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:35.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:35.748 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:35.748 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:35.805 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:35.805 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:35.805 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:35.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.482 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:36.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:36.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.581 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:36.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:36.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.633 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:36.645 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:36.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:36.691 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:36.691 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:36.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:36.720 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:36.720 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:36.747 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:36.747 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:36.747 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:36.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.777 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:36.778 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:36.778 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:36.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:36.807 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:36.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:36.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:36.911 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:36.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:36.989 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:36.989 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:37.044 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:37.045 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:37.045 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:37.045 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:37.748 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:37.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:37.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:37.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:37.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:37.900 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:37.911 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:37.958 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:37.958 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:37.958 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:37.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:37.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:37.988 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:38.013 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:38.013 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:38.013 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:38.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.044 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:38.044 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:38.044 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:38.044 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:38.046 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:38.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:38.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:38.114 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:38.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:38.185 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:38.185 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:38.240 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:38.241 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:38.241 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:38.241 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.015 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:39.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:39.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.114 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:39.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:39.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.167 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:39.178 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:39.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:39.224 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:39.224 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:39.242 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:39.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:39.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:39.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:39.250 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:39.250 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:39.310 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:39.315 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:39.315 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:39.315 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:39.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.317 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:39.317 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:39.317 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:39.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:39.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:39.380 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:39.381 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:39.438 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:39.438 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:39.438 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:39.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.316 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:40.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:40.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:40.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:40.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.440 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:40.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:40.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:40.448 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:40.504 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:40.513 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:40.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:40.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:40.520 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:40.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:40.523 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:40.523 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:40.575 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:40.575 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:40.576 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:40.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.580 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:40.580 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:40.580 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:40.580 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:40.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:40.583 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:40.583 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:40.639 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:40.639 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:40.640 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:40.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.577 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:41.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:41.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.580 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:41.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:41.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.675 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:41.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:41.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:41.721 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:41.733 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:41.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:41.807 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:41.808 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:41.817 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:41.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:41.823 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:41.823 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:41.864 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:41.864 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:41.864 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:41.864 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.879 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:41.879 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:41.879 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:41.880 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:41.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:41.890 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:41.890 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:41.946 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:41.946 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:41.946 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:41.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:42.865 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:42.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:42.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.923 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:42.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:42.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.974 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:42.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:42.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:42.975 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:43.026 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:43.035 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:43.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:43.042 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:43.042 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:43.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:43.084 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:43.084 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:43.097 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:43.097 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:43.097 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:43.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:43.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:43.108 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:43.108 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:43.140 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:43.140 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:43.140 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:43.140 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:43.164 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:43.165 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:43.165 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:43.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.098 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:44.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:44.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:44.196 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:44.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:44.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:44.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:44.250 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:44.302 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:44.303 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:44.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:44.309 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:44.309 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:44.364 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:44.364 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:44.365 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:44.365 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:44.376 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:44.376 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:44.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:44.379 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:44.380 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:44.432 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:44.432 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:44.432 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:44.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:44.436 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:44.436 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:44.437 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:44.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.366 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:45.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:45.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.465 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:45.465 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:45.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:45.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:45.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:45.517 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:45.568 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:45.571 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:45.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:45.577 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:45.577 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:45.632 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:45.632 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:45.632 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:45.632 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:45.649 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:45.649 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:45.649 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:45.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:45.650 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:45.705 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:45.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:45.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:45.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:45.707 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:45.707 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:45.707 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:45.707 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.632 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:46.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:46.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.731 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:46.731 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:46.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:46.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:46.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:46.784 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:46.836 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:46.836 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:46.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:46.842 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:46.842 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:46.898 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:46.898 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:46.898 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:46.898 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:46.907 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:46.907 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:46.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:46.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:46.908 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:46.963 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:46.963 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:46.963 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:46.964 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:46.966 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:46.967 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:46.967 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:46.967 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:47.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:47.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:47.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.997 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:47.997 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:47.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:47.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:47.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:47.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:48.050 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:48.100 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:48.103 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:48.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:48.108 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:48.109 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:48.163 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:48.163 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:48.163 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:48.163 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:48.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:48.175 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:48.176 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:48.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:48.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:48.178 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:48.231 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:48.232 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:48.232 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:48.232 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:48.233 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:48.234 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:48.234 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:48.234 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.165 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:49.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:49.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.264 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:49.264 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:49.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:49.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:49.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:49.317 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:49.367 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:49.370 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:49.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:49.376 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:49.376 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:49.431 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:49.432 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:49.432 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:49.432 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:49.443 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:49.443 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:49.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:49.445 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:49.445 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:49.499 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:49.499 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:49.499 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:49.500 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:49.501 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:49.502 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:49.502 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:49.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.432 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:50.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:50.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.533 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:50.533 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:50.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:50.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:50.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:50.586 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:50.638 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:50.638 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:50.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:50.645 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:50.645 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:50.701 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:50.701 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:50.701 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:50.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:50.709 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:50.710 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:50.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:50.714 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:50.714 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:50.766 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:50.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:50.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:50.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:50.770 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:50.771 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:50.771 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:50.771 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:51.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:51.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:51.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.802 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:51.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:51.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:51.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:51.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:51.854 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:51.904 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:51.908 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:51.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:51.915 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:51.915 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:51.970 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:51.971 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:51.971 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:51.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:51.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:51.975 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:51.975 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:51.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:51.983 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:51.983 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:52.031 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:52.031 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:52.032 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:52.032 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.038 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:52.039 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:52.039 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:52.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:52.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:52.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:52.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:53.070 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:53.071 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:53.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:53.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:53.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:53.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:53.124 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:53.174 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:53.177 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:53.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:53.182 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:53.182 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:53.238 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:53.238 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:53.238 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:53.238 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:53.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:53.243 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:53.244 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:53.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:53.261 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:53.261 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:53.301 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:53.301 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:53.301 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:53.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:53.317 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:53.317 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:53.317 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:53.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:54.239 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:54.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:54.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:54.337 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:54.338 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:54.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:54.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:54.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:54.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:54.390 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:54.440 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:54.444 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:54.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:54.449 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:54.449 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:54.504 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:54.504 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:54.504 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:54.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:54.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:54.512 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:54.513 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:54.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:54.520 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:54.520 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:54.568 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:54.568 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:54.569 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:54.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:54.575 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:54.576 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:54.576 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:54.576 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:55.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:55.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:55.605 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:55.605 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:55.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:55.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:55.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:55.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:55.657 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:55.707 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:55.711 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:55.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:55.716 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:55.716 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:55.771 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:55.771 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:55.772 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:55.772 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:55.782 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:55.782 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:55.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:55.786 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:55.786 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:55.838 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:55.838 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:55.839 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:55.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:55.843 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:55.843 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:55.844 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:55.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:56.773 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:56.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:56.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.872 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:56.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:56.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:56.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:56.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:56.925 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:56.975 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:56.978 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:56.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:56.984 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:56.984 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:57.039 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:57.039 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:57.039 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:57.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:57.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:57.047 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:57.047 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:57.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:57.053 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:57.053 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:57.103 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:57.103 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:57.103 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:57.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:57.111 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:57.111 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:57.111 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:57.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:58.040 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:58.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:58.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:58.139 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:58.140 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:58.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:58.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:58.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:58.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:58.192 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:58.243 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:58.246 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:58.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:58.251 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:58.251 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:58.308 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:58.308 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:58.308 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:58.308 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:58.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:58.316 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:58.316 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:58.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:58.319 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:58.319 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:58.372 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:58.372 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:58.372 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:58.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:58.375 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:58.375 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:58.375 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:58.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:59.310 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:56:59.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:59.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.409 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:56:59.409 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:56:59.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:59.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:59.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:56:59.461 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:56:59.512 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:56:59.515 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:56:59.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:56:59.519 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:59.519 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:56:59.574 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:59.574 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:59.575 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:59.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:59.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:56:59.583 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:59.583 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:56:59.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:56:59.592 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:56:59.592 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:56:59.639 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:59.639 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:59.639 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:59.639 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:56:59.649 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:56:59.650 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:56:59.650 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:56:59.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.575 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:00.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:00.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:00.674 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:00.675 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:00.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:00.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:00.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:00.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:00.732 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:00.782 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:00.785 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:00.789 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:00.789 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:00.789 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:00.845 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:00.845 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:00.845 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:00.845 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:00.858 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:00.858 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:00.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:00.859 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:00.859 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:00.915 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:00.915 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:00.915 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:00.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:00.917 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:00.917 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:00.917 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:00.917 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:01.846 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:01.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:01.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:01.946 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:01.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:01.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:01.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:01.999 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:02.050 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:02.051 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:02.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:02.057 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:02.058 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:02.113 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:02.113 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:02.113 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:02.113 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:02.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:02.125 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:02.125 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:02.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:02.126 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:02.126 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:02.180 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:02.181 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:02.181 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:02.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:02.182 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:02.182 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:02.183 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:02.183 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:03.115 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:03.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:03.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:03.214 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:03.214 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:03.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:03.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:03.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:03.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:03.266 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:03.318 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:03.319 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:03.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:03.326 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:03.326 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:03.380 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:03.381 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:03.381 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:03.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:03.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:03.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:03.392 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:03.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:03.402 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:03.402 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:03.448 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:03.448 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:03.448 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:03.448 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:03.458 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:03.459 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:03.459 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:03.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.382 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:04.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:04.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.482 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:04.482 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:04.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:04.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:04.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:04.534 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:04.586 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:04.586 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:04.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:04.593 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:04.593 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:04.648 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:04.649 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:04.649 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:04.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:04.662 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:04.662 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:04.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:04.664 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:04.664 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:04.718 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:04.718 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:04.719 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:04.719 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:04.721 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:04.721 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:04.721 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:04.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.649 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:05.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:05.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:05.748 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:05.748 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:05.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:05.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:05.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:05.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:05.800 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:05.852 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:05.852 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:05.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:05.859 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:05.859 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:05.915 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:05.915 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:05.915 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:05.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:05.923 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:05.923 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:05.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:05.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:05.924 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:05.980 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:05.980 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:05.980 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:05.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:05.982 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:05.982 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:05.983 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:05.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:06.916 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:06.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:06.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.015 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:07.015 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:07.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:07.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:07.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:07.068 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:07.118 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:07.121 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:07.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:07.129 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:07.129 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:07.185 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:07.185 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:07.185 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:07.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:07.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:07.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:07.190 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:07.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:07.196 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:07.196 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:07.246 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:07.246 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:07.247 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:07.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:07.252 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:07.252 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:07.252 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:07.253 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:08.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:08.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:08.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:08.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:08.285 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:08.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:08.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:08.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:08.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:08.339 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:08.391 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:08.391 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:08.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:08.397 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:08.397 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:08.452 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:08.452 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:08.452 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:08.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:08.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:08.465 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:08.465 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:08.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:08.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:08.470 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:08.520 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:08.520 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:08.521 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:08.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:08.526 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:08.526 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:08.526 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:08.526 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.453 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:09.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:09.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.551 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:09.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:09.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:09.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:09.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:09.604 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:09.655 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:09.658 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:09.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:09.663 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:09.663 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:09.720 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:09.721 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:09.721 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:09.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:09.734 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:09.734 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:09.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:09.737 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:09.737 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:09.792 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:09.792 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:09.792 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:09.792 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:09.794 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:09.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:09.794 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:09.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:10.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:10.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:10.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:10.822 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:10.822 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:10.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:10.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:10.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:10.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:10.875 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:10.928 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:10.928 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:10.935 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:10.935 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:10.935 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:10.990 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:10.990 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:10.990 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:10.990 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:10.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:10.998 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:10.998 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:11.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:11.004 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:11.004 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:11.055 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:11.056 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:11.056 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:11.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:11.059 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:11.059 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:11.060 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:11.060 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:11.991 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:11.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:11.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:12.090 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:12.090 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:12.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:12.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:12.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:12.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:12.143 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:12.194 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:12.197 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:12.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:12.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:12.202 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:12.257 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:12.257 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:12.257 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:12.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:12.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:12.269 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:12.269 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:12.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:12.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:12.275 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:12.326 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:12.327 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:12.327 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:12.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:12.331 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:12.331 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:12.331 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:12.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:13.258 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:13.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:13.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:13.358 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:13.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:13.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:13.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:13.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:13.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:13.412 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:13.462 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:13.466 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:13.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:13.472 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:13.472 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:13.527 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:13.528 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:13.528 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:13.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:13.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:13.536 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:13.536 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:13.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:13.543 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:13.543 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:13.592 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:13.592 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:13.592 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:13.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:13.601 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:13.601 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:13.601 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:13.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.529 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:14.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:14.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.630 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:14.630 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:14.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:14.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:14.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:14.682 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:14.732 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:14.736 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:14.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:14.741 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:14.741 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:14.798 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:14.798 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:14.798 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:14.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:14.810 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:14.810 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:14.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:14.813 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:14.813 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:14.866 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:14.866 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:14.867 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:14.867 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:14.868 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:14.869 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:14.869 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:14.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:15.799 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:15.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:15.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:15.897 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:15.897 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:15.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:15.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:15.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:15.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:15.949 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:15.999 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:16.003 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:16.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:16.008 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:16.008 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:16.064 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:16.064 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:16.064 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:16.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:16.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:16.075 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:16.075 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:16.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:16.079 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:16.079 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:16.131 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:16.131 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:16.131 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:16.131 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:16.136 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:16.136 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:16.136 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:16.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:17.065 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:17.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:17.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:17.164 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:17.164 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:17.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:17.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:17.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:17.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:17.217 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:17.267 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:17.270 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:17.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:17.276 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:17.276 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:17.332 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:17.333 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:17.333 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:17.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:17.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:17.347 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:17.347 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:17.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:17.350 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:17.350 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:17.403 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:17.403 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:17.403 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:17.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:17.406 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:17.406 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:17.406 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:17.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:18.334 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:18.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:18.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:18.434 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:18.434 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:18.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:18.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:18.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:18.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:18.487 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:18.537 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:18.541 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:18.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:18.546 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:18.546 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:18.601 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:18.601 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:18.601 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:18.601 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:18.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:18.609 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:18.609 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:18.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:18.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:18.615 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:18.665 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:18.665 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:18.665 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:18.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:18.670 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:18.670 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:18.671 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:18.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:19.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:19.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.702 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:19.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:19.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:19.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:19.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:19.754 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:19.805 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:19.808 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:19.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:19.812 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:19.812 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:19.868 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:19.868 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:19.868 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:19.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:19.875 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:19.875 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:19.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:19.881 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:19.881 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:19.930 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:19.930 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:19.930 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:19.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:19.937 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:19.937 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:19.937 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:19.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:20.869 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:20.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:20.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:20.969 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:20.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:20.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:20.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:20.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:20.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:21.022 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:21.072 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:21.075 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:21.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:21.081 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:21.081 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:21.137 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:21.137 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:21.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:21.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:21.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:21.144 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:21.145 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:21.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:21.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:21.150 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:21.200 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:21.200 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:21.201 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:21.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:21.207 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:21.207 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:21.207 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:21.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:22.138 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:22.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:22.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:22.237 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:22.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:22.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:22.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:22.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:22.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:22.291 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:22.341 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:22.344 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:22.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:22.350 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:22.350 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:22.406 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:22.406 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:22.406 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:22.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:22.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:22.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:22.416 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:22.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:22.417 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:22.417 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:22.472 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:22.472 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:22.473 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:22.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:22.474 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:22.475 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:22.475 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:22.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:23.407 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:23.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:23.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:23.506 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:23.506 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:23.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:23.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:23.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:23.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:23.559 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:23.611 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:23.611 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:23.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:23.618 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:23.618 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:23.673 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:23.673 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:23.673 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:23.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:23.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:23.682 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:23.682 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:23.689 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:23.689 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:23.689 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:23.739 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:23.740 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:23.740 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:23.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:23.748 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:23.748 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:23.748 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:23.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:24.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:24.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:24.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.773 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:24.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:24.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:24.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:24.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:24.826 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:24.876 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:24.880 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:24.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:24.885 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:24.885 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:24.940 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:24.941 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:24.941 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:24.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:24.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:24.951 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:24.951 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:24.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:24.953 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:24.953 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:25.007 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:25.007 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:25.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:25.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:25.011 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:25.012 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:25.012 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:25.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:25.942 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:25.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:25.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:26.042 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:26.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:26.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:26.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:26.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:26.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:26.095 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:26.146 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:26.150 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:26.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:26.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:26.155 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:26.211 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:26.211 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:26.211 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:26.211 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:26.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:26.219 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:26.220 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:26.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:26.230 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:26.230 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:26.275 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:26.276 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:26.276 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:26.276 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:26.287 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:26.288 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:26.288 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:26.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:27.212 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:27.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:27.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:27.312 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:27.312 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:27.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:27.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:27.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:27.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:27.364 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:27.415 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:27.418 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:27.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:27.424 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:27.424 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:27.481 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:27.481 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:27.481 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:27.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:27.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:27.491 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:27.491 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:27.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:27.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:27.496 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:27.546 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:27.546 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:27.547 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:27.547 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:27.552 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:27.552 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:27.552 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:27.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:28.482 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:28.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:28.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:28.581 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:28.581 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:28.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:28.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:28.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:28.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:28.634 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:28.684 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:28.688 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:28.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:28.693 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:28.693 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:28.748 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:28.748 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:28.748 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:28.748 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:28.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:28.761 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:28.761 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:28.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:28.761 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:28.761 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:28.816 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:28.816 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:28.816 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:28.816 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:28.817 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:28.817 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:28.817 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:28.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:29.749 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:29.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:29.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.848 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:29.848 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:29.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:29.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:29.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:29.901 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:29.952 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:29.956 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:29.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:29.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:29.961 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:30.016 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:30.016 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:30.016 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:30.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:30.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:30.029 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:30.029 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:30.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:30.030 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:30.030 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:30.085 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:30.085 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:30.085 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:30.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:30.087 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:30.087 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:30.087 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:30.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:31.016 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:31.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:31.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:31.115 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:31.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:31.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:31.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:31.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:31.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:31.168 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:31.218 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:31.222 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:31.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:31.228 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:31.228 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:31.284 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:31.285 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:31.285 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:31.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:31.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:31.293 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:31.294 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:31.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:31.295 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:31.295 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:31.349 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:31.349 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:31.350 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:31.350 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:31.352 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:31.352 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:31.352 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:31.353 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:32.286 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:32.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:32.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:32.386 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:32.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:32.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:32.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:32.438 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:32.490 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:32.490 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:32.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:32.497 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:32.497 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:32.552 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:32.552 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:32.552 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:32.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:32.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:32.561 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:32.561 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:32.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:32.566 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:32.566 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:32.618 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:32.618 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:32.618 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:32.618 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:32.624 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:32.624 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:32.625 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:32.625 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:33.553 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:33.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:33.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:33.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:33.654 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:33.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:33.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:33.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:33.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:33.706 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:33.759 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:33.759 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:33.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:33.765 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:33.765 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:33.820 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:33.821 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:33.821 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:33.821 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:33.830 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:33.830 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:33.830 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:33.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:33.834 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:33.834 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:33.886 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:33.887 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:33.887 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:33.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:33.890 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:33.890 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:33.891 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:33.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:34.821 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:34.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:34.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.920 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:34.920 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:34.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:34.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:34.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:34.973 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:35.023 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:35.026 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:35.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:35.031 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:35.031 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:35.086 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:35.086 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:35.087 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:35.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:35.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:35.099 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:35.099 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:35.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:35.102 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:35.102 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:35.155 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:35.155 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:35.155 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:35.155 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:35.159 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:35.160 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:35.160 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:35.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:36.088 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:36.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:36.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:36.187 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:36.188 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:36.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:36.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:36.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:36.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:36.241 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:36.291 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:36.294 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:36.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:36.300 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:36.300 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:36.354 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:36.354 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:36.354 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:36.354 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:36.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:36.363 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:36.363 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:36.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:36.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:36.370 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:36.419 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:36.419 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:36.419 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:36.419 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:36.425 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:36.425 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:36.426 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:36.426 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:37.355 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:37.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:37.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.420 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:37.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:37.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.427 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:37.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:37.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:37.428 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:37.482 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:37.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:37.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:37.499 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:37.568 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:37.572 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:37.572 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:37.572 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:37.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:37.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:37.573 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:37.573 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:37.629 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:37.629 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:37.629 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:37.629 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:37.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:37.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:37.642 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:37.698 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:37.699 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:37.699 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:37.699 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:38.573 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:38.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:38.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:38.630 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:38.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:38.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:38.681 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:38.690 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:38.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:38.697 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:38.697 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:38.700 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:38.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:38.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:38.762 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:38.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:38.766 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:38.766 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:38.766 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:38.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:38.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:38.766 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:38.823 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:38.823 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:38.823 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:38.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:38.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:38.832 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:38.832 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:38.888 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:38.889 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:38.889 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:38.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:39.767 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:39.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:39.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.825 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:39.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:39.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.832 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:39.885 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:39.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:39.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:39.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:39.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:39.941 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:39.941 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:39.952 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:39.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:39.959 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:39.959 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:39.997 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:39.997 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:39.997 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:39.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:40.015 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:40.015 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:40.015 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:40.015 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:40.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:40.027 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:40.027 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:40.083 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:40.083 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:40.083 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:40.083 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:40.998 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:40.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:40.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:41.050 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:41.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:41.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:41.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:41.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:41.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:41.104 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:41.157 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:41.166 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:41.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:41.172 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:41.172 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:41.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:41.173 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:41.174 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:41.228 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:41.228 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:41.228 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:41.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:41.229 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:41.229 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:41.229 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:41.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:41.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:41.243 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:41.243 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:41.300 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:41.301 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:41.301 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:41.301 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.229 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:42.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:42.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.232 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:42.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:42.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.326 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:42.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:42.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:42.371 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:42.384 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:42.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:42.462 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:42.462 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:42.473 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:42.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:42.478 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:42.478 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:42.519 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:42.519 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:42.519 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:42.519 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.533 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:42.533 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:42.533 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:42.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:42.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:42.547 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:42.547 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:42.604 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:42.605 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:42.605 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:42.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:43.521 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:43.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:43.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:43.621 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:43.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:43.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:43.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:43.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:43.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:43.674 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:43.729 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:43.729 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:43.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:43.734 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:43.734 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:43.791 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:43.791 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:43.791 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:43.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:43.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:43.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:43.802 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:43.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:43.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:43.805 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:43.858 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:43.859 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:43.859 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:43.859 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:43.863 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:43.863 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:43.863 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:43.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:44.792 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:44.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:44.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.891 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:44.891 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:44.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:44.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:44.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:44.943 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:44.996 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:44.999 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:45.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:45.002 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:45.002 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:45.059 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:45.059 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:45.059 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:45.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:45.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:45.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:45.069 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:45.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:45.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:45.071 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:45.124 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:45.125 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:45.125 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:45.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:45.126 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:45.126 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:45.126 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:45.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:46.060 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:46.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:46.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:46.157 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:46.157 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:46.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:46.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:46.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:46.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:46.209 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:46.263 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:46.263 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:46.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:46.268 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:46.268 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:46.325 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:46.325 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:46.325 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:46.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:46.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:46.335 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:46.335 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:46.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:46.339 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:46.339 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:46.390 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:46.391 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:46.391 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:46.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:46.395 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:46.396 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:46.396 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:46.396 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.325 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:47.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:47.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.420 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:47.420 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:47.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:47.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:47.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:47.473 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:47.525 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:47.528 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:47.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:47.532 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:47.532 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:47.588 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:47.588 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:47.588 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:47.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:47.599 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:47.599 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:47.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:47.600 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:47.600 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:47.657 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:47.658 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:47.658 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:47.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:47.659 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:47.660 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:47.660 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:47.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.589 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:48.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:48.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:48.688 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:48.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:48.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:48.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:48.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:48.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:48.741 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:48.794 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:48.797 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:48.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:48.799 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:48.799 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:48.854 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:48.855 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:48.855 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:48.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:48.867 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:48.867 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:48.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:48.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:48.874 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:48.922 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:48.923 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:48.923 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:48.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:48.929 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:48.929 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:48.929 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:48.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:49.855 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:49.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:49.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:49.955 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:49.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:49.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:49.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:49.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:49.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:50.008 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:50.060 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:50.063 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:50.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:50.067 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:50.067 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:50.122 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:50.122 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:50.122 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:50.122 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:50.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:50.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:50.134 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:50.136 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:50.136 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:50.136 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:50.190 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:50.190 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:50.190 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:50.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:50.192 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:50.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:50.193 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:50.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:51.123 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:51.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:51.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:51.222 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:51.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:51.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:51.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:51.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:51.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:51.275 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:51.328 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:51.330 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:51.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:51.334 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:51.334 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:51.389 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:51.389 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:51.389 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:51.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:51.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:51.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:51.403 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:51.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:51.405 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:51.405 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:51.458 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:51.459 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:51.459 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:51.459 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:51.462 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:51.462 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:51.462 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:51.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:52.390 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:52.391 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:52.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.488 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:52.489 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:52.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:52.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:52.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:52.542 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:52.594 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:52.597 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:52.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:52.601 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:52.601 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:52.658 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:52.658 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:52.658 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:52.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:52.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:52.667 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:52.667 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:52.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:52.675 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:52.675 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:52.723 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:52.724 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:52.724 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:52.724 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:52.731 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:52.731 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:52.731 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:52.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.659 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:53.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:53.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:53.759 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:53.759 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:53.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:53.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:53.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:53.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:53.812 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:53.864 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:53.867 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:53.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:53.871 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:53.871 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:53.928 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:53.928 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:53.928 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:53.928 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:53.938 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:53.938 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:53.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:53.939 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:53.939 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:53.993 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:53.993 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:53.993 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:53.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:53.995 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:53.995 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:53.995 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:53.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:54.930 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:54.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:54.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:55.029 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:55.029 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:55.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:55.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:55.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:55.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:55.082 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:55.134 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:55.138 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:55.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:55.139 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:55.139 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:55.195 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:55.195 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:55.195 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:55.195 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:55.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:55.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:55.203 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:55.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:55.213 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:55.214 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:55.260 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:55.261 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:55.261 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:55.261 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:55.270 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:55.270 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:55.271 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:55.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:56.197 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:56.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:56.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:56.295 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:56.296 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:56.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:56.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:56.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:56.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:56.349 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:56.402 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:56.405 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:56.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:56.409 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:56.409 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:56.464 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:56.465 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:56.465 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:56.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:56.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:56.476 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:56.476 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:56.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:56.476 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:56.476 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:56.531 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:56.531 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:56.531 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:56.531 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:56.532 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:56.533 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:56.533 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:56.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.465 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:57.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:57.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.565 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:57.565 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:57.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:57.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:57.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:57.617 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:57.669 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:57.673 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:57.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:57.677 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:57.677 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:57.732 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:57.732 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:57.732 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:57.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:57.741 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:57.741 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:57.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:57.745 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:57.746 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:57.798 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:57.798 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:57.798 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:57.798 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:57.803 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:57.803 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:57.803 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:57.803 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:58.733 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:57:58.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:58.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:58.833 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:57:58.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:57:58.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:58.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:58.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:58.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:57:58.888 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:57:58.940 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:57:58.943 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:57:58.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:57:58.946 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:58.946 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:57:59.003 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:59.003 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:59.003 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:59.003 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:59.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:57:59.012 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:59.012 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:57:59.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:57:59.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:57:59.014 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:57:59.067 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:59.067 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:59.067 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:59.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:57:59.069 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:57:59.069 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:57:59.069 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:57:59.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:00.004 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:00.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:00.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:00.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:00.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:00.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:00.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:00.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:00.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:00.153 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:00.205 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:00.208 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:00.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:00.210 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:00.210 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:00.266 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:00.266 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:00.266 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:00.266 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:00.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:00.280 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:00.280 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:00.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:00.285 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:00.285 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:00.336 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:00.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:00.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:00.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:00.342 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:00.342 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:00.343 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:00.343 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.267 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:01.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:01.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:01.366 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:01.366 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:01.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:01.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:01.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:01.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:01.419 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:01.471 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:01.474 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:01.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:01.477 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:01.477 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:01.532 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:01.533 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:01.533 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:01.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:01.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:01.550 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:01.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:01.555 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:01.556 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:01.606 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:01.606 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:01.606 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:01.606 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:01.612 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:01.612 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:01.613 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:01.613 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:02.533 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:02.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:02.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:02.632 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:02.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:02.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:02.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:02.685 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:02.738 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:02.741 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:02.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:02.745 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:02.745 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:02.801 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:02.801 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:02.801 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:02.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:02.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:02.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:02.810 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:02.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:02.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:02.815 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:02.869 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:02.869 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:02.869 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:02.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:02.871 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:02.872 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:02.872 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:02.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:03.802 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:03.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:03.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.902 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:03.902 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:03.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:03.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:03.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:03.956 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:04.008 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:04.011 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:04.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:04.015 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:04.015 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:04.070 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:04.071 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:04.071 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:04.071 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:04.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:04.079 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:04.079 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:04.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:04.080 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:04.080 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:04.135 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:04.135 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:04.136 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:04.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:04.137 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:04.137 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:04.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:04.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:05.071 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:05.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:05.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:05.171 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:05.171 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:05.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:05.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:05.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:05.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:05.224 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:05.277 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:05.277 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:05.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:05.281 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:05.281 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:05.338 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:05.339 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:05.339 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:05.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:05.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:05.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:05.348 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:05.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:05.355 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:05.355 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:05.404 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:05.404 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:05.404 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:05.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:05.411 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:05.411 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:05.412 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:05.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.339 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:06.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:06.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:06.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:06.439 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:06.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:06.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:06.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:06.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:06.491 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:06.543 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:06.547 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:06.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:06.550 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:06.550 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:06.605 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:06.605 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:06.605 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:06.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:06.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:06.615 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:06.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:06.630 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:06.631 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:06.671 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:06.671 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:06.672 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:06.672 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:06.679 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:06.679 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:06.679 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:06.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:07.606 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:07.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:07.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.704 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:07.705 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:07.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:07.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:07.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:07.757 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:07.809 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:07.813 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:07.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:07.816 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:07.816 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:07.871 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:07.871 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:07.871 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:07.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:07.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:07.882 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:07.882 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:07.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:07.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:07.889 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:07.939 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:07.940 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:07.940 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:07.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:07.945 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:07.945 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:07.945 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:07.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:08.872 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:08.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:08.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:08.971 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:08.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:08.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:08.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:08.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:08.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:09.024 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:09.077 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:09.077 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:09.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:09.082 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:09.082 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:09.137 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:09.138 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:09.138 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:09.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:09.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:09.149 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:09.149 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:09.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:09.155 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:09.155 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:09.205 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:09.206 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:09.206 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:09.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:09.211 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:09.211 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:09.212 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:09.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:10.139 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:10.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:10.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.238 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:10.238 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:10.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:10.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:10.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:10.291 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:10.343 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:10.346 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:10.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:10.350 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:10.350 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:10.407 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:10.407 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:10.407 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:10.407 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:10.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:10.415 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:10.415 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:10.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:10.421 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:10.421 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:10.470 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:10.471 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:10.471 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:10.471 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:10.477 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:10.477 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:10.477 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:10.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.408 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:11.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:11.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:11.506 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:11.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:11.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:11.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:11.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:11.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:11.559 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:11.611 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:11.614 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:11.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:11.619 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:11.619 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:11.674 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:11.674 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:11.674 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:11.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:11.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:11.688 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:11.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:11.695 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:11.695 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:11.746 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:11.750 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:11.750 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:11.750 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:11.753 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:11.754 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:11.754 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:11.754 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:12.676 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:12.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:12.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:12.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:12.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:12.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:12.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:12.827 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:12.879 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:12.882 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:12.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:12.885 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:12.886 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:12.943 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:12.943 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:12.943 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:12.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:12.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:12.952 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:12.952 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:12.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:12.953 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:12.953 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:13.007 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:13.008 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:13.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:13.008 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:13.011 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:13.011 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:13.011 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:13.012 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:13.944 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:13.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:13.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:14.043 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:14.043 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:14.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:14.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:14.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:14.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:14.096 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:14.148 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:14.151 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:14.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:14.156 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:14.156 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:14.212 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:14.212 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:14.212 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:14.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:14.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:14.224 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:14.224 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:14.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:14.225 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:14.226 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:14.281 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:14.282 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:14.282 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:14.282 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:14.283 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:14.284 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:14.284 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:14.284 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:15.213 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:15.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:15.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:15.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:15.313 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:15.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:15.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:15.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:15.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:15.366 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:15.418 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:15.421 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:15.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:15.425 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:15.425 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:15.480 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:15.480 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:15.480 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:15.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:15.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:15.489 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:15.489 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:15.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:15.494 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:15.495 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:15.545 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:15.545 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:15.545 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:15.546 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:15.552 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:15.553 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:15.553 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:15.553 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.482 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:16.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:16.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.583 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:16.583 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:16.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:16.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:16.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:16.636 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:16.688 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:16.691 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:16.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:16.695 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:16.695 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:16.750 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:16.751 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:16.751 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:16.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:16.756 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:16.756 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:16.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:16.767 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:16.767 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:16.811 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:16.811 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:16.812 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:16.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:16.823 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:16.824 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:16.824 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:16.824 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:17.751 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:17.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:17.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:17.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:17.850 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:17.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:17.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:17.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:17.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:17.903 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:17.955 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:17.958 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:17.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:17.962 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:17.962 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:18.017 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:18.018 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:18.018 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:18.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:18.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:18.030 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:18.030 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:18.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:18.033 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:18.034 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:18.086 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:18.086 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:18.086 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:18.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:18.089 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:18.089 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:18.090 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:18.090 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:19.019 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:19.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:19.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:19.120 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:19.120 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:19.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:19.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:19.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:19.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:19.173 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:19.225 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:19.228 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:19.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:19.232 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:19.232 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:19.288 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:19.288 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:19.288 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:19.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:19.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:19.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:19.300 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:19.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:19.305 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:19.305 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:19.356 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:19.356 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:19.356 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:19.356 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:19.360 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:19.360 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:19.360 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:19.360 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:20.289 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:20.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:20.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:20.389 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:20.389 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:20.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:20.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:20.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:20.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:20.442 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:20.495 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:20.498 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:20.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:20.502 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:20.503 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:20.560 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:20.560 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:20.560 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:20.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:20.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:20.568 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:20.568 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:20.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:20.574 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:20.575 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:20.625 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:20.625 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:20.626 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:20.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:20.630 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:20.631 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:20.631 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:20.631 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.561 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:21.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:21.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:21.662 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:21.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:21.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:21.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:21.714 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:21.767 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:21.770 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:21.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:21.774 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:21.774 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:21.829 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:21.829 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:21.829 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:21.829 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:21.837 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:21.837 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:21.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:21.845 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:21.845 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:21.893 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:21.893 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:21.893 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:21.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:21.902 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:21.902 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:21.902 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:21.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:22.830 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:22.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:22.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:22.930 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:22.930 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:22.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:22.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:22.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:22.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:22.983 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:23.036 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:23.039 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:23.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:23.042 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:23.042 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:23.098 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:23.098 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:23.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:23.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:23.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:23.109 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:23.109 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:23.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:23.119 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:23.119 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:23.164 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:23.165 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:23.165 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:23.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:23.175 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:23.175 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:23.175 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:23.176 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:24.099 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:24.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:24.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:24.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:24.199 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:24.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:24.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:24.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:24.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:24.252 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:24.304 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:24.308 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:24.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:24.311 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:24.311 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:24.368 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:24.368 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:24.368 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:24.368 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:24.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:24.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:24.376 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:24.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:24.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:24.381 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:24.432 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:24.433 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:24.433 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:24.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:24.438 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:24.439 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:24.439 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:24.439 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:25.370 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:25.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:25.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:25.470 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:25.470 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:25.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:25.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:25.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:25.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:25.523 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:25.575 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:25.578 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:25.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:25.582 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:25.582 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:25.637 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:25.637 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:25.637 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:25.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:25.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:25.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:25.649 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:25.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:25.652 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:25.652 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:25.705 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:25.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:25.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:25.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:25.708 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:25.709 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:25.709 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:25.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.638 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:26.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:26.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.738 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:26.738 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:26.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:26.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:26.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:26.791 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:26.843 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:26.846 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:26.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:26.849 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:26.850 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:26.907 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:26.907 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:26.907 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:26.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:26.913 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:26.913 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:26.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:26.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:26.922 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:26.968 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:26.968 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:26.969 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:26.969 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:26.977 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:26.977 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:26.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:26.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:27.908 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:27.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:27.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:28.033 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:28.033 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:28.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:28.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:28.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:28.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:28.042 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:28.139 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:28.142 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:28.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:28.143 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:28.144 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:28.199 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:28.199 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:28.199 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:28.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:28.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:28.208 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:28.208 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:28.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:28.214 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:28.214 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:28.263 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:28.264 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:28.264 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:28.264 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:28.270 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:28.270 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:28.270 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:28.271 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:29.201 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:29.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:29.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:29.300 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:29.300 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:29.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:29.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:29.301 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:29.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:29.352 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:29.405 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:29.408 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:29.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:29.411 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:29.412 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:29.467 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:29.467 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:29.467 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:29.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:29.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:29.479 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:29.479 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:29.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:29.481 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:29.481 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:29.535 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:29.535 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:29.535 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:29.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:29.537 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:29.537 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:29.537 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:29.538 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:30.468 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:30.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:30.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:30.567 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:30.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:30.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:30.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:30.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:30.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:30.620 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:30.675 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:30.675 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:30.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:30.679 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:30.679 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:30.734 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:30.734 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:30.734 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:30.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:30.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:30.747 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:30.747 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:30.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:30.750 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:30.750 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:30.803 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:30.804 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:30.804 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:30.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:30.806 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:30.806 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:30.806 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:30.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:31.735 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:31.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:31.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.834 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:31.834 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:31.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:31.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:31.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:31.887 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:31.939 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:31.942 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:31.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:31.944 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:31.944 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:32.000 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:32.000 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:32.000 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:32.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:32.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:32.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:32.010 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:32.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:32.020 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:32.020 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:32.065 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:32.066 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:32.066 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:32.066 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:32.075 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:32.075 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:32.076 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:32.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:33.001 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:33.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:33.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:33.067 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:33.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:33.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:33.076 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:33.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:33.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:33.120 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:33.167 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:33.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:33.167 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:33.167 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:33.180 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:33.223 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:33.224 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:33.224 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:33.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:33.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:33.224 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:33.224 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:33.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:33.251 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:33.251 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:33.280 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:33.280 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:33.280 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:33.280 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:33.305 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:33.306 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:33.306 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:33.306 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:34.225 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:34.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:34.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.324 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:34.324 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:34.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:34.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:34.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:34.377 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:34.430 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:34.432 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:34.436 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:34.436 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:34.437 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:34.494 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:34.494 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:34.494 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:34.494 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:34.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:34.501 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:34.501 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:34.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:34.503 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:34.503 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:34.556 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:34.557 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:34.557 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:34.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:34.560 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:34.560 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:34.560 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:34.560 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.495 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:35.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:35.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:35.593 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:35.594 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:35.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:35.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:35.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:35.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:35.654 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:35.719 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:35.724 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:35.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:35.726 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:35.726 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:35.784 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:35.784 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:35.784 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:35.784 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:35.793 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:35.793 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:35.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:35.801 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:35.801 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:35.849 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:35.850 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:35.850 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:35.850 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:35.857 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:35.857 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:35.857 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:35.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:36.785 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:36.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:36.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.880 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:36.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:36.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:36.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:36.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:36.935 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:36.977 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:36.990 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:36.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:36.993 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:36.993 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:37.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:37.033 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:37.033 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:37.050 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:37.050 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:37.050 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:37.050 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:37.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:37.071 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:37.072 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:37.089 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:37.089 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:37.089 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:37.089 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:37.127 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:37.128 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:37.128 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:37.128 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:38.051 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:38.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:38.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:38.150 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:38.151 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:38.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:38.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:38.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:38.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:38.204 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:38.256 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:38.259 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:38.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:38.264 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:38.264 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:38.321 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:38.321 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:38.321 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:38.321 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:38.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:38.331 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:38.331 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:38.334 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:38.334 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:38.334 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:38.387 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:38.387 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:38.387 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:38.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:38.390 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:38.390 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:38.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:38.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.322 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:39.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:39.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.421 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:39.421 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:39.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:39.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:39.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:39.475 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:39.527 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:39.530 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:39.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:39.533 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:39.533 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:39.589 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:39.589 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:39.589 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:39.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:39.600 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:39.601 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:39.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:39.604 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:39.604 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:39.657 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:39.657 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:39.658 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:39.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:39.662 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:39.662 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:39.662 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:39.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.590 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:40.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:40.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:40.692 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:40.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:40.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:40.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:40.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:40.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:40.745 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:40.798 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:40.801 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:40.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:40.805 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:40.805 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:40.860 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:40.860 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:40.860 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:40.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:40.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:40.872 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:40.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:40.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:40.873 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:40.928 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:40.929 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:40.929 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:40.929 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:40.930 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:40.931 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:40.931 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:40.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:41.861 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:41.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:41.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:41.960 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:41.960 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:41.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:41.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:41.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:41.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:42.014 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:42.068 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:42.068 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:42.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:42.073 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:42.073 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:42.128 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:42.128 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:42.128 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:42.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:42.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:42.138 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:42.138 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:42.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:42.143 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:42.143 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:42.196 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:42.196 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:42.197 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:42.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:42.199 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:42.199 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:42.199 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:42.199 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:43.130 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:43.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:43.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:43.231 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:43.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:43.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:43.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:43.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:43.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:43.286 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:43.339 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:43.340 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:43.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:43.344 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:43.344 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:43.401 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:43.401 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:43.401 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:43.402 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:43.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:43.412 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:43.412 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:43.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:43.417 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:43.417 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:43.468 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:43.468 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:43.469 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:43.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:43.473 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:43.473 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:43.473 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:43.473 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.403 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:44.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:44.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.503 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:44.503 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:44.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:44.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:44.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:44.556 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:44.610 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:44.610 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:44.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:44.615 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:44.615 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:44.674 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:44.674 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:44.674 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:44.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:44.681 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:44.681 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:44.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:44.682 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:44.682 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:44.737 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:44.737 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:44.737 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:44.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:44.740 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:44.740 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:44.740 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:44.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:45.675 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:45.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:45.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:45.774 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:45.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:45.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:45.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:45.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:45.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:45.827 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:45.881 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:45.881 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:45.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:45.887 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:45.887 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:45.944 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:45.945 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:45.945 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:45.945 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:45.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:45.956 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:45.956 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:45.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:45.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:45.959 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:46.012 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:46.012 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:46.013 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:46.013 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:46.016 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:46.016 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:46.016 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:46.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:46.945 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:46.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:46.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:47.044 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:47.044 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:47.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:47.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:47.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:47.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:47.097 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:47.151 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:47.151 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:47.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:47.157 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:47.157 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:47.214 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:47.215 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:47.215 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:47.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:47.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:47.221 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:47.221 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:47.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:47.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:47.227 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:47.277 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:47.277 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:47.277 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:47.277 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:47.284 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:47.284 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:47.284 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:47.284 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:48.215 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:48.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:48.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:48.286 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:48.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:48.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:48.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:48.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:48.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:48.339 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:48.392 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:48.393 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:48.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:48.396 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:48.396 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:48.451 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:48.452 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:48.452 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:48.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:48.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:48.467 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:48.467 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:48.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:48.467 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:48.467 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:48.522 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:48.522 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:48.522 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:48.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:48.524 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:48.524 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:48.524 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:48.524 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.452 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:49.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:49.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.551 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:49.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:49.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:49.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:49.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:49.604 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:49.657 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:49.657 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:49.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:49.663 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:49.663 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:49.720 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:49.720 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:49.720 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:49.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:49.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:49.729 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:49.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:49.732 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:49.732 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:49.787 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:49.787 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:49.787 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:49.787 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:49.789 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:49.789 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:49.790 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:49.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:50.721 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:50.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:50.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:50.820 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:50.820 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:50.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:50.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:50.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:50.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:50.873 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:50.925 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:50.929 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:50.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:50.932 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:50.932 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:50.988 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:50.988 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:50.988 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:50.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:51.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:51.002 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:51.002 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:51.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:51.004 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:51.004 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:51.058 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:51.058 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:51.058 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:51.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:51.062 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:51.062 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:51.062 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:51.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:51.989 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:51.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:51.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:52.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:52.088 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:52.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:52.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:52.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:52.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:52.141 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:52.193 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:52.197 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:52.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:52.200 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:52.200 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:52.257 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:52.257 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:52.257 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:52.257 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:52.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:52.263 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:52.263 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:52.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:52.267 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:52.267 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:52.319 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:52.320 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:52.320 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:52.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:52.325 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:52.325 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:52.325 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:52.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:53.258 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:53.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:53.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:53.328 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:53.328 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:53.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:53.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:53.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:53.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:53.381 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:53.433 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:53.436 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:53.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:53.440 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:53.440 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:53.495 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:53.495 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:53.495 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:53.495 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:53.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:53.510 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:53.510 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:53.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:53.513 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:53.513 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:53.565 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:53.565 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:53.565 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:53.566 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:53.571 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:53.571 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:53.571 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:53.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:54.496 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:54.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:54.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:54.594 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:54.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:54.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:54.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:54.648 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:54.700 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:54.703 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:54.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:54.705 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:54.705 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:54.761 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:54.761 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:54.761 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:54.761 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:54.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:54.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:54.778 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:54.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:54.783 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:54.783 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:54.835 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:54.835 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:54.835 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:54.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:54.839 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:54.839 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:54.839 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:54.839 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:55.761 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:55.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:55.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.859 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:55.860 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:55.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:55.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:55.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:55.913 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:55.965 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:55.968 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:55.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:55.971 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:55.971 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:56.027 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:56.027 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:56.027 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:56.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:56.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:56.041 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:56.041 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:56.046 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:56.046 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:56.047 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:56.098 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:56.098 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:56.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:56.098 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:56.104 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:56.104 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:56.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:56.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:57.028 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:57.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:57.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:57.095 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:57.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:57.100 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:57.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:57.105 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:57.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:57.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:57.166 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:57.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:57.170 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:57.170 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:57.254 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:57.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:57.258 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:57.258 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:57.258 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:57.258 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:57.258 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:57.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:57.313 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:57.313 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:57.313 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:57.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:57.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:57.324 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:57.325 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:57.381 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:57.381 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:57.381 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:57.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:58.259 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:58.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:58.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:58.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:58.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:58.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:58.409 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:58.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:58.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:58.415 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:58.464 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:58.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:58.465 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:58.465 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:58.477 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:58.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:58.521 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:58.521 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:58.522 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:58.522 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:58.522 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:58.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:58.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:58.548 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:58.548 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:58.579 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:58.579 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:58.579 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:58.579 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:58.603 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:58.603 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:58.603 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:58.603 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:59.523 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:58:59.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:59.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.618 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:58:59.618 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:58:59.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:59.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:59.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:58:59.670 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:58:59.722 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:58:59.725 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:58:59.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:58:59.729 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:59.729 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:58:59.785 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:59.785 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:59.786 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:59.786 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:59.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:58:59.794 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:59.794 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:58:59.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:58:59.795 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:58:59.795 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:58:59.851 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:59.852 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:59.852 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:59.852 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:58:59.853 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:58:59.853 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:58:59.853 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:58:59.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:00.786 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:00.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:00.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:00.885 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:00.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:00.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:00.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:00.939 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:00.990 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:00.994 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:00.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:00.997 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:00.998 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:01.055 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:01.055 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:01.055 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:01.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:01.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:01.065 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:01.065 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:01.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:01.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:01.069 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:01.122 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:01.122 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:01.122 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:01.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:01.125 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:01.125 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:01.125 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:01.125 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:02.055 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:02.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:02.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:02.155 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:02.155 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:02.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:02.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:02.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:02.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:02.208 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:02.260 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:02.263 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:02.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:02.265 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:02.266 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:02.322 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:02.322 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:02.322 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:02.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:02.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:02.332 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:02.332 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:02.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:02.333 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:02.333 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:02.388 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:02.388 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:02.388 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:02.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:02.389 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:02.390 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:02.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:02.390 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.323 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:03.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:03.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:03.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:03.423 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:03.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:03.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:03.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:03.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:03.477 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:03.530 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:03.531 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:03.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:03.536 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:03.536 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:03.591 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:03.591 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:03.591 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:03.591 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:03.600 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:03.600 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:03.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:03.611 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:03.611 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:03.656 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:03.657 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:03.657 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:03.657 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:03.668 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:03.668 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:03.668 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:03.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:04.592 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:04.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:04.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:04.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:04.692 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:04.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:04.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:04.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:04.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:04.744 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:04.798 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:04.798 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:04.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:04.803 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:04.803 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:04.860 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:04.860 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:04.860 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:04.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:04.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:04.868 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:04.868 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:04.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:04.877 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:04.877 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:04.924 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:04.925 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:04.925 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:04.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:04.934 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:04.934 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:04.934 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:04.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:05.861 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:05.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:05.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:05.926 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:05.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:05.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:05.931 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:05.936 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:05.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:05.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:06.025 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:06.037 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:06.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:06.041 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:06.041 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:06.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:06.082 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:06.082 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:06.097 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:06.097 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:06.097 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:06.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:06.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:06.105 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:06.105 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:06.137 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:06.137 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:06.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:06.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:06.162 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:06.162 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:06.162 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:06.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:07.098 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:07.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:07.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:07.195 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:07.196 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:07.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:07.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:07.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:07.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:07.204 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:07.303 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:07.303 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:07.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:07.309 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:07.309 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:07.366 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:07.366 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:07.366 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:07.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:07.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:07.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:07.376 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:07.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:07.380 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:07.380 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:07.432 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:07.432 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:07.433 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:07.433 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:07.435 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:07.435 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:07.435 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:07.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:08.368 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:08.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:08.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:08.469 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:08.469 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:08.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:08.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:08.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:08.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:08.522 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:08.576 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:08.579 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:08.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:08.583 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:08.583 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:08.638 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:08.638 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:08.638 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:08.638 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:08.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:08.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:08.649 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:08.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:08.653 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:08.653 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:08.704 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:08.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:08.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:08.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:08.709 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:08.709 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:08.709 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:08.709 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:09.639 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:09.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:09.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:09.740 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:09.740 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:09.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:09.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:09.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:09.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:09.791 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:09.844 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:09.847 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:09.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:09.851 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:09.851 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:09.906 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:09.906 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:09.907 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:09.907 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:09.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:09.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:09.921 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:09.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:09.927 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:09.927 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:09.977 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:09.977 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:09.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:09.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:09.983 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:09.983 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:09.983 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:09.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:10.907 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:10.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:10.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:11.008 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:11.008 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:11.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:11.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:11.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:11.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:11.061 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:11.114 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:11.117 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:11.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:11.120 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:11.120 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:11.177 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:11.178 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:11.178 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:11.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:11.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:11.184 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:11.184 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:11.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:11.191 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:11.191 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:11.239 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:11.240 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:11.240 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:11.240 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:11.248 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:11.248 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:11.248 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:11.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:12.179 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:12.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:12.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:12.271 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:12.271 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:12.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:12.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:12.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:12.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:12.324 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:12.376 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:12.379 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:12.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:12.382 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:12.382 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:12.438 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:12.438 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:12.438 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:12.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:12.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:12.452 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:12.452 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:12.453 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:12.453 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:12.453 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:12.507 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:12.507 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:12.508 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:12.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:12.509 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:12.509 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:12.509 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:12.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:13.439 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:13.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:13.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:13.538 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:13.539 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:13.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:13.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:13.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:13.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:13.591 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:13.643 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:13.646 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:13.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:13.650 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:13.650 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:13.705 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:13.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:13.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:13.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:13.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:13.721 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:13.721 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:13.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:13.725 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:13.725 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:13.778 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:13.778 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:13.778 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:13.778 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:13.782 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:13.782 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:13.782 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:13.782 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:14.706 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:14.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:14.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:14.773 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:14.780 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:14.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:14.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:14.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:14.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:14.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:14.881 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:14.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:14.881 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:14.881 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:14.894 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:14.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:14.937 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:14.937 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:14.939 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:14.939 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:14.939 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:14.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:14.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:14.972 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:14.972 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:14.995 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:14.995 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:14.995 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:14.995 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:15.029 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:15.029 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:15.030 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:15.030 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:15.940 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:15.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:15.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:16.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:16.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:16.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:16.059 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:16.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:16.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:16.060 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:16.111 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:16.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:16.111 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:16.111 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:16.124 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:16.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:16.168 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:16.168 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:16.168 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:16.168 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:16.168 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:16.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:16.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:16.195 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:16.195 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:16.223 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:16.223 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:16.223 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:16.223 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:16.250 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:16.250 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:16.250 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:16.250 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:17.169 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:17.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:17.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:17.267 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:17.267 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:17.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:17.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:17.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:17.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:17.320 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:17.372 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:17.376 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:17.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:17.379 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:17.379 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:17.436 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:17.436 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:17.436 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:17.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:17.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:17.444 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:17.444 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:17.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:17.448 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:17.448 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:17.501 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:17.501 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:17.502 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:17.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:17.504 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:17.505 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:17.505 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:17.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:18.438 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:18.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:18.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:18.513 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:18.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:18.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:18.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:18.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:18.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:18.566 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:18.618 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:18.620 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:18.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:18.623 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:18.623 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:18.680 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:18.680 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:18.680 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:18.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:18.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:18.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:18.688 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:18.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:18.690 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:18.690 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:18.743 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:18.744 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:18.744 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:18.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:18.747 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:18.747 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:18.747 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:18.747 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:19.681 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:19.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:19.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:19.741 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:19.745 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:19.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:19.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:19.748 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:19.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:19.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:19.844 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:19.857 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:19.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:19.861 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:19.861 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:19.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:19.902 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:19.902 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:19.918 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:19.918 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:19.918 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:19.918 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:19.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:19.928 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:19.928 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:19.960 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:19.960 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:19.960 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:19.960 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:19.986 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:19.986 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:19.986 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:19.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:20.919 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:20.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:20.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:21.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:21.018 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:21.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:21.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:21.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:21.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:21.079 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:21.132 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:21.135 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:21.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:21.139 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:21.139 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:21.195 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:21.195 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:21.196 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:21.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:21.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:21.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:21.203 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:21.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:21.211 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:21.211 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:21.257 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:21.258 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:21.258 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:21.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:21.268 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:21.268 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:21.268 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:21.268 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:22.197 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:22.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:22.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:22.297 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:22.297 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:22.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:22.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:22.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:22.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:22.350 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:22.403 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:22.406 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:22.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:22.409 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:22.410 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:22.465 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:22.465 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:22.465 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:22.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:22.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:22.474 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:22.474 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:22.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:22.487 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:22.488 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:22.532 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:22.532 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:22.532 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:22.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:22.543 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:22.543 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:22.543 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:22.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:23.466 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:23.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:23.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:23.563 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:23.563 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:23.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:23.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:23.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:23.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:23.615 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:23.669 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:23.669 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:23.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:23.674 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:23.675 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:23.733 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:23.733 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:23.734 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:23.734 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:23.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:23.743 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:23.743 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:23.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:23.744 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:23.744 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:23.799 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:23.800 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:23.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:23.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:23.801 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:23.801 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:23.801 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:23.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:24.735 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:24.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:24.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:24.836 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:24.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:24.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:24.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:24.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:24.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:24.890 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:24.943 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:24.944 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:24.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:24.949 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:24.949 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:25.007 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:25.007 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:25.007 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:25.007 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:25.019 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:25.019 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:25.019 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:25.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:25.020 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:25.020 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:25.075 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:25.076 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:25.076 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:25.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:25.078 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:25.078 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:25.078 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:25.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:26.008 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:26.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:26.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:26.096 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:26.096 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:26.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:26.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:26.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:26.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:26.148 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:26.200 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:26.203 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:26.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:26.206 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:26.206 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:26.261 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:26.261 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:26.262 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:26.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:26.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:26.275 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:26.275 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:26.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:26.279 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:26.279 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:26.331 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:26.331 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:26.332 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:26.332 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:26.336 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:26.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:26.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:26.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:27.262 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:27.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:27.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:27.362 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:27.363 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:27.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:27.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:27.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:27.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:27.416 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:27.469 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:27.472 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:27.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:27.475 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:27.475 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:27.533 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:27.533 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:27.533 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:27.533 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:27.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:27.541 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:27.541 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:27.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:27.553 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:27.553 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:27.597 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:27.597 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:27.597 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:27.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:27.609 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:27.609 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:27.609 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:27.609 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:28.534 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:28.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:28.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:28.594 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:28.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:28.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:28.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:28.670 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:28.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:28.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:28.741 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:28.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:28.741 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:28.742 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:28.754 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:28.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:28.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:28.758 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:28.799 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:28.799 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:28.799 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:28.799 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:28.814 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:28.814 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:28.814 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:28.814 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:28.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:28.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:28.831 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:28.887 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:28.887 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:28.887 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:28.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:29.800 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:29.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:29.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:29.898 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:29.899 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:29.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:29.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:29.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:29.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:29.952 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:30.005 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:30.008 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:30.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:30.012 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:30.012 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:30.068 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:30.068 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:30.068 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:30.068 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:30.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:30.082 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:30.082 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:30.083 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:30.083 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:30.083 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:30.140 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:30.141 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:30.141 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:30.141 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:30.142 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:30.143 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:30.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:30.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:31.069 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:31.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:31.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:31.142 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:31.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:31.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:31.144 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:31.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:31.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:31.147 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:31.251 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:31.254 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:31.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:31.258 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:31.258 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:31.315 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:31.315 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:31.315 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:31.315 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:31.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:31.326 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:31.326 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:31.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:31.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:31.333 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:31.381 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:31.381 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:31.381 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:31.381 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:31.388 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:31.388 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:31.388 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:31.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:32.316 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:32.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:32.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:32.416 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:32.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:32.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:32.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:32.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:32.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:32.468 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:32.521 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:32.524 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:32.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:32.528 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:32.528 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:32.584 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:32.584 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:32.584 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:32.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:32.597 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:32.597 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:32.597 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:32.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:32.602 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:32.602 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:32.653 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:32.653 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:32.653 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:32.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:32.660 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:32.661 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:32.661 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:32.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:33.584 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:33.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:33.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:33.684 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:33.684 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:33.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:33.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:33.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:33.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:33.737 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:33.790 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:33.793 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:33.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:33.797 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:33.797 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:33.853 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:33.853 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:33.853 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:33.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:33.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:33.864 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:33.864 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:33.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:33.869 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:33.870 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:33.920 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:33.920 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:33.920 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:33.920 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:33.925 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:33.925 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:33.925 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:33.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:34.855 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:34.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:34.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:34.954 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:34.955 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:34.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:34.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:34.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:34.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:35.009 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:35.061 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:35.064 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:35.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:35.066 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:35.066 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:35.120 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:35.121 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:35.121 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:35.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:35.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:35.134 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:35.134 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:35.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:35.135 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:35.135 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:35.191 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:35.191 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:35.192 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:35.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:35.193 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:35.193 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:35.194 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:35.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:36.122 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:36.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:36.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:36.222 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:36.223 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:36.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:36.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:36.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:36.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:36.276 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:36.329 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:36.332 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:36.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:36.335 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:36.335 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:36.391 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:36.391 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:36.391 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:36.391 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:36.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:36.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:36.401 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:36.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:36.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:36.410 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:36.457 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:36.457 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:36.458 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:36.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:36.465 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:36.466 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:36.466 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:36.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:37.393 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:37.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:37.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:37.457 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:37.458 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:37.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:37.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:37.467 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:37.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:37.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:37.557 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:37.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:37.558 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:37.558 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:37.569 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:37.614 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:37.614 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:37.614 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:37.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:37.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:37.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:37.615 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:37.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:37.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:37.642 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:37.671 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:37.671 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:37.671 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:37.671 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:37.699 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:37.699 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:37.700 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:37.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:38.615 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:38.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:38.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:38.715 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:38.715 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:38.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:38.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:38.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:38.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:38.725 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:38.823 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:38.823 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:38.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:38.829 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:38.829 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:38.884 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:38.884 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:38.884 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:38.884 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:38.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:38.895 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:38.895 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:38.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:38.896 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:38.896 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:38.951 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:38.951 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:38.951 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:38.951 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:38.952 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:38.953 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:38.953 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:38.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:39.885 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:39.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:39.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:39.951 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:39.952 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:39.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:39.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:39.953 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:39.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:39.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:40.058 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:40.061 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:40.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:40.065 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:40.065 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:40.120 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:40.121 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:40.121 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:40.121 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:40.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:40.133 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:40.133 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:40.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:40.137 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:40.138 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:40.189 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:40.189 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:40.189 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:40.189 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:40.193 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:40.194 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:40.194 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:40.194 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:41.122 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:41.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:41.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:41.221 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:41.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:41.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:41.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:41.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:41.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:41.278 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:41.330 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:41.333 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:41.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:41.336 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:41.336 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:41.392 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:41.392 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:41.392 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:41.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:41.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:41.409 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:41.409 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:41.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:41.410 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:41.410 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:41.464 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:41.465 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:41.465 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:41.465 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:41.466 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:41.466 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:41.467 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:41.467 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:42.393 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:42.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:42.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:42.493 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:42.493 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:42.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:42.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:42.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:42.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:42.547 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:42.599 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:42.602 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:42.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:42.606 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:42.606 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:42.663 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:42.663 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:42.663 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:42.663 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:42.671 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:42.671 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:42.671 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:42.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:42.683 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:42.683 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:42.727 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:42.727 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:42.727 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:42.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:42.740 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:42.740 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:42.741 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:42.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:43.664 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:43.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:43.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:43.724 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:43.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:43.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:43.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:43.780 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:43.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:43.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:43.832 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:43.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:43.833 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:43.833 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:43.846 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:43.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:43.849 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:43.849 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:43.889 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:43.889 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:43.889 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:43.889 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:43.907 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:43.911 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:43.911 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:43.911 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:43.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:43.920 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:43.920 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:43.977 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:43.977 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:43.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:43.977 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:44.890 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:44.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:44.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:44.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:44.990 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:44.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:44.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:44.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:44.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:45.044 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:45.097 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:45.100 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:45.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:45.105 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:45.105 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:45.160 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:45.160 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:45.160 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:45.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:45.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:45.169 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:45.169 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:45.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:45.174 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:45.174 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:45.224 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:45.224 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:45.224 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:45.224 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:45.230 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:45.230 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:45.230 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:45.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:46.161 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:46.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:46.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:46.262 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:46.262 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:46.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:46.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:46.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:46.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:46.315 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:46.368 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:46.371 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:46.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:46.374 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:46.374 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:46.430 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:46.430 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:46.430 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:46.430 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:46.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:46.443 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:46.443 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:46.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:46.445 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:46.445 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:46.498 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:46.498 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:46.498 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:46.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:46.501 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:46.501 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:46.501 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:46.501 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:47.431 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:47.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:47.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:47.492 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:47.499 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:47.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:47.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:47.502 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:47.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:47.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:47.597 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:47.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:47.598 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:47.598 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:47.609 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:47.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:47.654 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:47.654 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:47.655 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:47.655 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:47.655 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:47.655 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:47.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:47.685 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:47.685 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:47.710 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:47.710 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:47.710 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:47.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:47.741 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:47.742 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:47.742 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:47.742 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:48.655 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:48.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:48.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:48.746 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:48.746 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:48.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:48.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:48.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:48.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:48.799 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:48.853 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:48.853 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:48.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:48.856 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:48.857 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:48.912 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:48.912 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:48.912 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:48.912 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:48.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:48.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:48.924 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:48.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:48.929 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:48.929 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:48.980 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:48.980 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:48.981 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:48.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:48.985 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:48.985 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:48.986 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:48.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:49.913 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:49.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:49.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:50.014 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:50.014 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:50.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:50.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:50.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:50.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:50.069 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:50.121 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:50.124 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:50.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:50.128 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:50.128 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:50.184 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:50.184 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:50.184 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:50.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:50.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:50.195 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:50.195 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:50.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:50.202 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:50.202 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:50.252 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:50.252 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:50.252 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:50.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:50.258 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:50.258 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:50.258 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:50.258 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:51.184 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:51.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:51.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:51.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:51.285 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:51.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:51.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:51.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:51.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:51.339 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:51.391 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:51.395 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:51.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:51.398 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:51.398 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:51.453 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:51.453 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:51.453 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:51.453 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:51.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:51.461 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:51.461 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:51.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:51.464 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:51.464 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:51.518 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:51.518 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:51.518 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:51.518 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:51.522 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:51.522 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:51.522 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:51.522 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:52.454 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:52.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:52.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:52.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:52.554 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:52.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:52.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:52.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:52.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:52.607 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:52.658 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:52.662 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:52.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:52.666 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:52.666 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:52.721 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:52.721 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:52.721 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:52.721 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:52.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:52.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:52.733 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:52.739 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:52.739 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:52.739 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:52.791 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:52.791 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:52.791 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:52.791 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:52.794 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:52.795 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:52.795 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:52.795 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:53.722 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:53.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:53.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:53.821 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:53.821 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:53.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:53.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:53.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:53.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:53.875 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:53.927 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:53.931 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:53.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:53.934 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:53.934 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:53.991 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:53.992 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:53.992 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:53.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:54.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:54.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:54.000 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:54.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:54.004 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:54.004 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:54.056 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:54.056 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:54.056 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:54.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:54.062 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:54.062 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:54.062 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:54.062 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:54.993 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:54.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:54.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:55.078 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:55.078 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:55.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:55.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:55.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:55.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:55.087 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:55.190 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:55.192 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:55.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:55.197 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:55.197 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:55.252 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:55.252 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:55.252 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:55.252 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:55.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:55.263 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:55.263 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:55.269 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:55.269 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:55.269 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:55.319 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:55.319 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:55.319 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:55.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:55.325 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:55.325 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:55.325 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:55.325 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:56.253 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:56.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:56.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:56.336 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:56.336 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:56.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:56.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:56.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:56.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:56.345 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:56.444 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:56.445 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:56.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:56.449 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:56.449 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:56.505 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:56.505 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:56.505 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:56.505 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:56.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:56.515 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:56.515 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:56.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:56.517 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:56.517 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:56.571 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:56.571 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:56.571 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:56.571 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:56.575 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:56.575 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:56.575 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:56.575 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:57.507 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:57.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:57.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:57.568 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:57.572 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:57.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:57.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:57.577 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:57.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:57.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:57.638 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:57.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:57.643 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:57.644 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:57.723 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:57.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:57.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:57.727 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:57.727 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:57.727 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:57.727 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:57.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:57.782 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:57.783 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:57.783 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:57.783 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:57.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:57.802 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:57.803 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:57.859 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:57.860 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:57.860 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:57.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:58.728 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:58.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:58.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:58.826 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:59:58.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:58.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:58.878 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:59:58.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:58.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:59:58.879 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T22:59:58.929 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T22:59:58.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:58.930 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:58.930 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T22:59:58.941 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T22:59:58.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T22:59:58.987 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:58.987 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T22:59:58.987 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:58.987 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:58.987 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:58.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:59.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T22:59:59.021 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T22:59:59.021 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T22:59:59.042 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:59.042 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:59.042 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:59.042 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:59.077 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T22:59:59.078 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T22:59:59.078 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T22:59:59.078 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:59:59.989 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T22:59:59.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T22:59:59.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:00.088 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:00.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:00.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:00.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:00.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:00.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:00.099 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:00.190 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:00.201 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:00.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:00.205 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:00.205 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:00.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:00.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:00.247 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:00.259 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:00.259 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:00.260 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:00.260 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:00.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:00.274 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:00.274 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:00.302 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:00.302 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:00.302 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:00.302 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:00.330 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:00.330 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:00.330 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:00.330 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:01.261 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:01.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:01.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:01.360 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:01.360 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:01.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:01.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:01.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:01.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:01.414 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:01.468 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:01.469 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:01.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:01.473 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:01.473 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:01.531 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:01.532 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:01.532 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:01.532 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:01.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:01.537 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:01.537 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:01.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:01.539 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:01.540 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:01.594 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:01.594 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:01.594 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:01.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:01.596 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:01.596 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:01.596 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:01.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:02.532 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:02.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:02.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:02.632 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:02.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:02.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:02.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:02.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:02.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:02.685 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:02.739 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:02.739 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:02.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:02.744 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:02.744 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:02.800 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:02.800 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:02.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:02.800 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:02.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:02.808 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:02.808 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:02.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:02.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:02.815 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:02.864 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:02.865 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:02.865 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:02.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:02.872 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:02.872 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:02.872 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:02.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:03.801 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:03.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:03.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:03.861 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:03.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:03.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:03.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:03.874 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:03.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:03.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:03.963 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:03.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:03.963 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:03.963 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:03.976 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:04.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:04.020 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:04.020 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:04.021 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:04.021 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:04.021 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:04.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:04.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:04.048 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:04.048 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:04.075 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:04.075 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:04.075 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:04.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:04.103 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:04.103 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:04.104 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:04.104 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:05.021 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:05.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:05.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:05.121 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:05.121 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:05.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:05.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:05.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:05.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:05.174 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:05.227 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:05.227 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:05.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:05.233 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:05.233 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:05.288 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:05.288 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:05.288 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:05.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:05.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:05.298 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:05.298 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:05.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:05.301 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:05.301 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:05.354 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:05.354 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:05.354 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:05.355 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:05.357 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:05.357 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:05.358 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:05.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:06.289 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:06.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:06.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:06.388 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:06.388 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:06.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:06.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:06.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:06.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:06.442 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:06.494 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:06.497 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:06.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:06.500 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:06.500 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:06.556 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:06.556 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:06.556 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:06.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:06.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:06.567 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:06.567 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:06.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:06.569 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:06.569 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:06.623 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:06.623 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:06.623 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:06.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:06.626 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:06.626 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:06.626 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:06.626 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:07.557 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:07.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:07.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:07.656 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:07.656 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:07.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:07.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:07.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:07.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:07.709 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:07.761 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:07.764 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:07.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:07.767 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:07.768 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:07.824 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:07.825 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:07.825 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:07.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:07.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:07.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:07.836 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:07.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:07.836 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:07.836 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:07.894 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:07.894 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:07.894 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:07.894 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:07.896 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:07.896 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:07.896 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:07.896 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:08.825 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:08.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:08.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:08.924 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:08.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:08.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:08.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:08.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:08.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:08.978 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:09.032 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:09.033 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:09.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:09.036 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:09.036 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:09.091 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:09.092 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:09.092 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:09.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:09.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:09.103 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:09.103 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:09.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:09.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:09.112 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:09.158 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:09.158 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:09.159 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:09.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:09.168 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:09.168 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:09.168 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:09.168 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:10.093 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:10.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:10.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:10.158 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:10.160 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:10.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:10.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:10.169 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:10.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:10.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:10.259 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:10.272 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:10.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:10.275 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:10.275 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:10.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:10.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:10.316 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:10.329 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:10.329 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:10.329 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:10.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:10.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:10.347 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:10.347 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:10.372 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:10.372 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:10.372 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:10.372 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:10.403 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:10.404 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:10.404 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:10.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:11.330 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:11.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:11.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:11.426 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:11.426 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:11.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:11.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:11.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:11.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:11.479 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:11.531 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:11.534 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:11.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:11.538 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:11.538 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:11.593 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:11.593 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:11.593 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:11.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:11.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:11.605 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:11.605 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:11.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:11.609 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:11.609 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:11.661 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:11.662 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:11.662 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:11.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:11.664 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:11.664 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:11.664 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:11.665 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:12.594 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:12.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:12.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:12.659 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:12.663 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:12.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:12.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:12.665 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:12.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:12.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:12.760 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:12.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:12.761 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:12.761 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:12.772 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:12.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:12.816 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:12.817 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:12.818 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:12.818 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:12.818 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:12.818 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:12.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:12.845 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:12.845 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:12.872 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:12.872 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:12.872 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:12.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:12.903 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:12.903 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:12.903 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:12.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:13.819 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:13.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:13.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:13.874 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:13.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:13.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:13.879 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:13.925 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:13.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:13.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:13.977 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:13.988 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:13.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:13.993 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:13.993 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:14.033 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:14.033 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:14.034 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:14.049 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:14.049 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:14.049 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:14.049 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:14.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:14.064 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:14.064 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:14.088 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:14.088 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:14.088 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:14.088 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:14.120 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:14.120 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:14.120 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:14.120 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:15.050 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:15.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:15.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:15.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:15.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:15.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:15.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:15.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:15.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:15.154 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:15.204 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:15.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:15.205 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:15.205 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:15.216 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:15.262 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:15.262 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:15.262 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:15.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:15.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:15.262 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:15.262 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:15.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:15.291 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:15.292 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:15.318 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:15.318 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:15.318 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:15.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:15.347 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:15.347 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:15.347 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:15.347 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:16.263 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:16.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:16.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:16.319 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:16.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:16.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:16.325 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:16.370 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:16.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:16.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:16.422 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:16.433 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:16.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:16.438 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:16.438 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:16.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:16.479 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:16.479 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:16.493 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:16.493 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:16.493 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:16.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:16.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:16.505 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:16.505 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:16.536 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:16.537 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:16.537 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:16.537 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:16.560 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:16.561 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:16.561 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:16.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:17.494 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:17.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:17.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:17.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:17.569 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:17.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:17.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:17.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:17.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:17.577 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:17.678 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:17.678 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:17.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:17.683 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:17.683 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:17.741 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:17.741 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:17.741 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:17.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:17.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:17.749 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:17.749 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:17.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:17.756 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:17.756 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:17.804 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:17.804 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:17.804 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:17.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:17.812 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:17.812 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:17.812 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:17.812 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:18.742 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:18.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:18.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:18.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:18.843 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:18.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:18.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:18.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:18.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:18.852 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:18.942 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:18.953 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:18.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:18.959 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:18.959 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:18.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:19.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:19.000 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:19.013 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:19.014 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:19.014 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:19.014 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:19.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:19.028 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:19.028 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:19.055 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:19.055 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:19.055 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:19.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:19.085 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:19.086 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:19.086 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:19.086 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:20.015 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:20.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:20.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:20.097 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:20.098 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:20.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:20.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:20.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:20.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:20.151 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:20.204 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:20.207 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:20.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:20.211 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:20.211 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:20.267 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:20.267 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:20.267 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:20.267 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:20.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:20.277 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:20.277 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:20.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:20.278 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:20.278 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:20.334 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:20.334 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:20.334 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:20.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:20.336 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:20.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:20.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:20.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:21.268 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:21.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:21.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:21.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:21.367 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:21.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:21.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:21.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:21.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:21.422 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:21.474 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:21.477 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:21.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:21.480 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:21.480 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:21.536 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:21.536 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:21.536 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:21.536 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:21.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:21.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:21.549 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:21.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:21.553 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:21.553 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:21.606 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:21.607 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:21.607 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:21.607 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:21.609 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:21.610 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:21.610 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:21.610 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:22.537 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:22.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:22.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:22.636 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:22.636 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:22.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:22.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:22.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:22.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:22.646 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:22.748 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:22.753 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:22.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:22.758 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:22.758 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:22.812 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:22.813 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:22.813 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:22.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:22.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:22.824 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:22.824 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:22.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:22.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:22.832 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:22.879 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:22.879 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:22.879 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:22.879 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:22.887 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:22.887 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:22.887 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:22.887 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:23.814 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:23.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:23.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:23.914 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:23.914 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:23.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:23.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:23.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:23.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:23.966 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:24.019 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:24.022 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:24.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:24.024 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:24.024 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:24.080 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:24.080 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:24.080 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:24.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:24.086 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:24.086 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:24.086 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:24.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:24.092 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:24.092 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:24.143 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:24.143 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:24.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:24.143 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:24.149 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:24.149 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:24.149 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:24.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:25.081 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:25.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:25.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:25.144 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:25.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:25.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:25.147 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:25.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:25.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:25.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:25.249 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:25.258 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:25.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:25.263 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:25.263 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:25.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:25.307 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:25.307 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:25.319 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:25.319 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:25.319 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:25.319 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:25.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:25.331 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:25.331 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:25.362 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:25.362 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:25.362 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:25.362 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:25.387 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:25.388 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:25.388 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:25.388 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:26.320 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:26.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:26.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:26.373 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:26.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:26.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:26.382 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:26.426 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:26.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:26.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:26.480 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:26.489 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:26.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:26.495 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:26.495 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:26.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:26.495 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:26.495 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:26.550 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:26.550 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:26.550 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:26.550 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:26.552 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:26.552 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:26.552 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:26.552 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:26.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:26.566 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:26.566 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:26.623 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:26.624 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:26.624 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:26.624 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:27.551 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:27.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:27.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:27.553 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:27.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:27.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:27.629 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:27.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:27.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:27.679 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:27.733 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:27.744 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:27.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:27.749 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:27.749 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:27.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:27.750 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:27.750 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:27.804 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:27.804 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:27.804 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:27.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:27.805 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:27.805 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:27.805 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:27.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:27.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:27.816 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:27.816 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:27.872 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:27.872 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:27.872 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:27.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:28.804 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:28.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:28.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:28.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:28.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:28.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:28.904 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:28.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:28.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:28.914 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:28.957 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:28.968 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:28.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:28.989 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:28.989 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:29.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:29.014 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:29.014 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:29.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:29.040 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:29.040 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:29.044 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:29.045 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:29.045 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:29.045 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:29.069 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:29.069 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:29.069 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:29.069 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:29.095 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:29.095 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:29.096 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:29.096 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:30.046 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:30.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:30.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:30.101 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:30.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:30.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:30.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:30.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:30.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:30.153 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:30.207 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:30.207 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:30.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:30.213 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:30.213 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:30.270 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:30.270 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:30.270 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:30.270 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:30.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:30.278 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:30.278 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:30.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:30.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:30.280 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:30.333 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:30.334 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:30.334 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:30.334 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:30.336 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:30.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:30.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:30.336 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:31.271 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:31.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:31.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:31.371 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:31.371 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:31.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:31.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:31.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:31.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:31.467 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:31.469 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:31.478 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:31.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:31.485 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:31.485 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:31.527 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:31.527 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:31.527 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:31.540 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:31.540 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:31.540 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:31.540 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:31.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:31.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:31.550 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:31.583 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:31.583 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:31.583 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:31.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:31.605 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:31.605 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:31.605 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:31.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:32.541 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:32.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:32.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:32.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:32.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:32.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:32.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:32.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:32.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:32.650 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:32.749 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:32.749 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:32.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:32.756 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:32.756 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:32.812 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:32.813 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:32.813 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:32.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:32.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:32.816 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:32.816 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:32.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:32.832 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:32.832 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:32.875 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:32.875 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:32.875 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:32.875 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:32.887 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:32.888 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:32.888 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:32.888 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:33.814 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:33.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:33.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:33.895 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:33.896 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:33.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:33.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:33.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:33.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:33.948 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:34.000 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:34.004 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:34.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:34.007 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:34.007 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:34.064 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:34.065 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:34.065 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:34.065 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:34.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:34.073 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:34.073 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:34.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:34.082 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:34.082 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:34.129 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:34.129 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:34.129 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:34.129 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:34.139 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:34.139 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:34.139 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:34.139 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:35.066 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:35.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:35.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:35.133 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:35.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:35.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:35.140 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:35.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:35.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:35.142 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:35.198 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:35.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:35.210 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:35.210 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:35.285 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:35.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:35.286 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:35.286 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:35.288 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:35.289 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:35.289 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:35.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:35.341 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:35.341 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:35.341 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:35.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:35.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:35.358 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:35.358 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:35.415 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:35.416 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:35.416 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:35.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:36.289 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T23:00:36.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:36.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:36.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T23:00:36.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:36.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:36.395 DEBUG:teuthology.orchestra.run.trial188:> true 2026-02-12T23:00:36.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T23:00:36.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:36.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T23:00:36.492 DEBUG:teuthology.orchestra.run.trial013:> true 2026-02-12T23:00:36.505 DEBUG:teuthology.orchestra.run.trial123:> true 2026-02-12T23:00:36.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial188.front.sepia.ceph.com' 2026-02-12T23:00:36.509 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:36.509 DEBUG:teuthology.orchestra.run.trial188:> uname -r 2026-02-12T23:00:36.549 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial013.front.sepia.ceph.com' 2026-02-12T23:00:36.549 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:36.549 DEBUG:teuthology.orchestra.run.trial013:> uname -r 2026-02-12T23:00:36.566 INFO:teuthology.orchestra.run.trial188.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:36.566 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:36.566 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:36.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:36.567 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:36.568 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T23:00:36.580 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T23:00:36.611 INFO:teuthology.run:Summary data: description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T23:00:36.611 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T23:00:36.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial123.front.sepia.ceph.com' 2026-02-12T23:00:36.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T23:00:36.613 DEBUG:teuthology.orchestra.run.trial123:> uname -r 2026-02-12T23:00:36.665 INFO:teuthology.orchestra.run.trial013.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:36.666 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:36.666 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:36.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:36.681 INFO:teuthology.orchestra.run.trial123.stdout:5.14.0-645.el9.x86_64 2026-02-12T23:00:36.682 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T23:00:36.682 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T23:00:36.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T23:00:36.704 INFO:teuthology.run:FAIL