2026-02-12T22:49:39.870 INFO:root:teuthology version: 1.2.4.dev7+g3e9168473 2026-02-12T22:49:39.892 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:49:39.974 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47314 branch: wip-pdonnell-testing-20260210.171210 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47314' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: fs: - name: a - name: b session_timeout: 300 cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_shutdown_timeout: 120 fuse set user groups: true global: ms die on skipped message: false mds: mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* - Replacing daemon mds sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v2 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 155 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 447/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCO6o0u+tTxgnySg3IPQyiR+jaJi4Tp/S3x9CtyD4Eu2vbSiCVSuJjjJd6iX2LmS08LbGVHU7YaMllCsg6lruGA= trial154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFUTf9/Ygi+l8r/du3UBl7I1A1SrbLkA7j+giQKL7kgfuya+SlqeAJPUGltmB7ykSTcnr4Sl1S0TOOAJ303hyZQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - kclient: null - mds_thrash: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: - /tank/home/pdonnell/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/suites/fs/thrash/multifs/mount/kclient/overrides/distro/testing/k-testing.yaml meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-2 teuthology_sha1: 3e9168473cad21309cea53f654286d78057913dd timestamp: 2026-02-12_20:30:49 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T22:49:39.974 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-12T22:49:39.975 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-12T22:49:39.975 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T22:49:39.976 INFO:teuthology.task.internal:Checking packages... 2026-02-12T22:49:39.976 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-12T22:49:39.976 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T22:49:39.976 INFO:teuthology.packaging:ref: None 2026-02-12T22:49:39.976 INFO:teuthology.packaging:tag: None 2026-02-12T22:49:39.976 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-12T22:49:39.976 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-12T22:49:39.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-12T22:49:40.102 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-12T22:49:40.103 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T22:49:40.112 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T22:49:40.113 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T22:49:40.126 INFO:teuthology.task.internal:Saving configuration 2026-02-12T22:49:40.146 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T22:49:40.157 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T22:49:40.229 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial112.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47314', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:46:21.182811', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCO6o0u+tTxgnySg3IPQyiR+jaJi4Tp/S3x9CtyD4Eu2vbSiCVSuJjjJd6iX2LmS08LbGVHU7YaMllCsg6lruGA='} 2026-02-12T22:49:40.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial154.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-12_20:30:49-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47314', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 22:46:21.182192', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFUTf9/Ygi+l8r/du3UBl7I1A1SrbLkA7j+giQKL7kgfuya+SlqeAJPUGltmB7ykSTcnr4Sl1S0TOOAJ303hyZQ='} 2026-02-12T22:49:40.286 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T22:49:40.297 INFO:teuthology.task.internal:roles: ubuntu@trial112.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-12T22:49:40.297 INFO:teuthology.task.internal:roles: ubuntu@trial154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-12T22:49:40.297 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T22:49:40.475 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd0f0e2cb80>, signals=[15]) 2026-02-12T22:49:40.475 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T22:49:40.486 INFO:teuthology.task.internal:Opening connections... 2026-02-12T22:49:40.486 DEBUG:teuthology.task.internal:connecting to ubuntu@trial112.front.sepia.ceph.com 2026-02-12T22:49:40.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.548 DEBUG:teuthology.task.internal:connecting to ubuntu@trial154.front.sepia.ceph.com 2026-02-12T22:49:40.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:49:40.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T22:49:40.621 DEBUG:teuthology.orchestra.run.trial112:> uname -m 2026-02-12T22:49:40.637 INFO:teuthology.orchestra.run.trial112.stdout:x86_64 2026-02-12T22:49:40.637 DEBUG:teuthology.orchestra.run.trial112:> cat /etc/os-release 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:NAME="Rocky Linux" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:ID="rocky" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:VERSION_ID="10.1" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:ANSI_COLOR="0;32" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:VENDOR_NAME="RESF" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:49:40.694 INFO:teuthology.orchestra.run.trial112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:49:40.694 INFO:teuthology.lock.ops:Updating trial112.front.sepia.ceph.com on lock server 2026-02-12T22:49:40.752 DEBUG:teuthology.orchestra.run.trial154:> uname -m 2026-02-12T22:49:40.768 INFO:teuthology.orchestra.run.trial154.stdout:x86_64 2026-02-12T22:49:40.768 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:NAME="Rocky Linux" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="10.1 (Red Quartz)" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:ID="rocky" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel centos fedora" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="10.1" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el10" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;32" 2026-02-12T22:49:40.823 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://rockylinux.org/" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:VENDOR_NAME="RESF" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:VENDOR_URL="https://resf.org/" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:SUPPORT_END="2035-05-31" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-12T22:49:40.824 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-12T22:49:40.824 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server 2026-02-12T22:49:40.899 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T22:49:40.911 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T22:49:40.922 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T22:49:40.922 DEBUG:teuthology.orchestra.run.trial112:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:49:40.924 DEBUG:teuthology.orchestra.run.trial154:> test '!' -e /home/ubuntu/cephtest 2026-02-12T22:49:40.940 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T22:49:40.950 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T22:49:40.950 DEBUG:teuthology.orchestra.run.trial112:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:49:40.980 DEBUG:teuthology.orchestra.run.trial154:> test -z $(ls -A /var/lib/ceph) 2026-02-12T22:49:40.995 INFO:teuthology.orchestra.run.trial112.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:49:40.997 INFO:teuthology.orchestra.run.trial154.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-12T22:49:40.998 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T22:49:41.160 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T22:49:41.178 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-12T22:49:41.178 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}}, timeout 300 2026-02-12T22:49:41.178 DEBUG:teuthology.orchestra.run.trial112:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:49:41.179 DEBUG:teuthology.orchestra.run.trial154:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T22:49:41.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:49:41.195 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:49:41.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T22:49:41.195 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:49:41.249 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.249 INFO:teuthology.task.kernel:Running kernel on trial154: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.249 DEBUG:teuthology.orchestra.run.trial154:> sudo yum install -y kernel 2026-02-12T22:49:41.251 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.251 INFO:teuthology.task.kernel:Running kernel on trial112: 6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:49:41.252 DEBUG:teuthology.orchestra.run.trial112:> sudo yum install -y kernel 2026-02-12T22:49:41.764 INFO:teuthology.orchestra.run.trial112.stdout:Rocky Linux 10 - AppStream 20 MB/s | 2.2 MB 00:00 2026-02-12T22:49:41.966 INFO:teuthology.orchestra.run.trial154.stdout:Rocky Linux 10 - AppStream 6.3 MB/s | 2.2 MB 00:00 2026-02-12T22:49:42.117 INFO:teuthology.orchestra.run.trial112.stdout:Rocky Linux 10 - BaseOS 48 MB/s | 11 MB 00:00 2026-02-12T22:49:42.312 INFO:teuthology.orchestra.run.trial154.stdout:Rocky Linux 10 - BaseOS 46 MB/s | 11 MB 00:00 2026-02-12T22:49:42.618 INFO:teuthology.orchestra.run.trial112.stdout:Rocky Linux 10 - CRB 5.4 MB/s | 507 kB 00:00 2026-02-12T22:49:42.818 INFO:teuthology.orchestra.run.trial154.stdout:Rocky Linux 10 - CRB 4.7 MB/s | 507 kB 00:00 2026-02-12T22:49:43.190 INFO:teuthology.orchestra.run.trial112.stdout:Extra Packages for Enterprise Linux 12 MB/s | 6.2 MB 00:00 2026-02-12T22:49:43.434 INFO:teuthology.orchestra.run.trial154.stdout:Extra Packages for Enterprise Linux 10 MB/s | 6.2 MB 00:00 2026-02-12T22:49:43.851 INFO:teuthology.orchestra.run.trial112.stdout:lab-extras 169 kB/s | 3.7 kB 00:00 2026-02-12T22:49:44.083 INFO:teuthology.orchestra.run.trial154.stdout:lab-extras 297 kB/s | 3.7 kB 00:00 2026-02-12T22:49:44.260 INFO:teuthology.orchestra.run.trial112.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:49:44.271 INFO:teuthology.orchestra.run.trial112.stdout:Dependencies resolved. 2026-02-12T22:49:44.272 INFO:teuthology.orchestra.run.trial112.stdout:================================================================================ 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: Package Arch Version Repo Size 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout:================================================================================ 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout:Installing: 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout:Installing dependencies: 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:49:44.273 INFO:teuthology.orchestra.run.trial112.stdout: 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout:Transaction Summary 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout:================================================================================ 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout:Install 5 Packages 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout: 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout:Total download size: 93 M 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout:Installed size: 135 M 2026-02-12T22:49:44.274 INFO:teuthology.orchestra.run.trial112.stdout:Downloading Packages: 2026-02-12T22:49:44.337 INFO:teuthology.orchestra.run.trial112.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 22 MB/s | 1.4 MB 00:00 2026-02-12T22:49:44.488 INFO:teuthology.orchestra.run.trial154.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-12T22:49:44.500 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T22:49:44.501 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T22:49:44.501 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T22:49:44.501 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout:Install 5 Packages 2026-02-12T22:49:44.502 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T22:49:44.503 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 93 M 2026-02-12T22:49:44.503 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 135 M 2026-02-12T22:49:44.503 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T22:49:44.513 INFO:teuthology.orchestra.run.trial112.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 77 MB/s | 18 MB 00:00 2026-02-12T22:49:44.560 INFO:teuthology.orchestra.run.trial154.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 24 MB/s | 1.4 MB 00:00 2026-02-12T22:49:44.578 INFO:teuthology.orchestra.run.trial112.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 43 MB/s | 2.8 MB 00:00 2026-02-12T22:49:44.761 INFO:teuthology.orchestra.run.trial112.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 70 MB/s | 30 MB 00:00 2026-02-12T22:49:44.818 INFO:teuthology.orchestra.run.trial154.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 58 MB/s | 18 MB 00:00 2026-02-12T22:49:44.871 INFO:teuthology.orchestra.run.trial154.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 52 MB/s | 2.8 MB 00:00 2026-02-12T22:49:44.911 INFO:teuthology.orchestra.run.trial112.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 64 MB/s | 41 MB 00:00 2026-02-12T22:49:44.912 INFO:teuthology.orchestra.run.trial112.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:49:44.912 INFO:teuthology.orchestra.run.trial112.stdout:Total 145 MB/s | 93 MB 00:00 2026-02-12T22:49:44.913 INFO:teuthology.orchestra.run.trial112.stdout:Running transaction check 2026-02-12T22:49:44.980 INFO:teuthology.orchestra.run.trial154.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 70 MB/s | 30 MB 00:00 2026-02-12T22:49:45.054 INFO:teuthology.orchestra.run.trial112.stdout:Transaction check succeeded. 2026-02-12T22:49:45.054 INFO:teuthology.orchestra.run.trial112.stdout:Running transaction test 2026-02-12T22:49:45.107 INFO:teuthology.orchestra.run.trial154.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 67 MB/s | 41 MB 00:00 2026-02-12T22:49:45.108 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T22:49:45.108 INFO:teuthology.orchestra.run.trial154.stdout:Total 153 MB/s | 93 MB 00:00 2026-02-12T22:49:45.108 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T22:49:45.253 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T22:49:45.253 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T22:49:45.456 INFO:teuthology.orchestra.run.trial112.stdout:Transaction test succeeded. 2026-02-12T22:49:45.457 INFO:teuthology.orchestra.run.trial112.stdout:Running transaction 2026-02-12T22:49:45.655 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T22:49:45.655 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T22:49:46.153 INFO:teuthology.orchestra.run.trial112.stdout: Preparing : 1/1 2026-02-12T22:49:46.349 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T22:49:46.356 INFO:teuthology.orchestra.run.trial112.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:49:46.377 INFO:teuthology.orchestra.run.trial112.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:49:46.550 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-12T22:49:46.572 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:49:47.641 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:49:47.668 INFO:teuthology.orchestra.run.trial112.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:49:47.830 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-12T22:49:47.857 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:49:49.510 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:49:49.516 INFO:teuthology.orchestra.run.trial112.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:49:49.699 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-12T22:49:49.704 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:49:51.375 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:49:51.385 INFO:teuthology.orchestra.run.trial112.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:51.566 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-12T22:49:51.575 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:53.247 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:49:53.441 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:26.892 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:26.914 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:27.038 INFO:teuthology.orchestra.run.trial112.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:27.038 INFO:teuthology.orchestra.run.trial112.stdout: 2026-02-12T22:50:27.038 INFO:teuthology.orchestra.run.trial112.stdout:Installed: 2026-02-12T22:50:27.038 INFO:teuthology.orchestra.run.trial112.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.038 INFO:teuthology.orchestra.run.trial112.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.038 INFO:teuthology.orchestra.run.trial112.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.039 INFO:teuthology.orchestra.run.trial112.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.039 INFO:teuthology.orchestra.run.trial112.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.039 INFO:teuthology.orchestra.run.trial112.stdout: 2026-02-12T22:50:27.039 INFO:teuthology.orchestra.run.trial112.stdout:Complete! 2026-02-12T22:50:27.104 DEBUG:teuthology.orchestra.run.trial112:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:50:27.179 INFO:teuthology.orchestra.run.trial112.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.180 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.180 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.180 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:50:27.181 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:50:27.181 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T22:50:27.181 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial112.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:50:27.181 DEBUG:teuthology.orchestra.run.trial112:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:50:27.219 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:27.240 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:27.253 INFO:teuthology.orchestra.run.trial112.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.253 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.254 DEBUG:teuthology.orchestra.run.trial112:> sudo rpm -qi grub2-tools 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Name : grub2-tools 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Epoch : 1 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Version : 2.12 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Release : 29.el10_1 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Architecture: x86_64 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Group : Unspecified 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Size : 7963769 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:License : GPL-3.0-or-later 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Signature : 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Packager : Release Engineering 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Summary : Support tools for GRUB. 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout:Description : 2026-02-12T22:50:27.327 INFO:teuthology.orchestra.run.trial112.stdout: 2026-02-12T22:50:27.328 INFO:teuthology.orchestra.run.trial112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:50:27.328 INFO:teuthology.orchestra.run.trial112.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:50:27.328 INFO:teuthology.orchestra.run.trial112.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:50:27.328 INFO:teuthology.orchestra.run.trial112.stdout:hardware devices. 2026-02-12T22:50:27.328 INFO:teuthology.orchestra.run.trial112.stdout: 2026-02-12T22:50:27.328 INFO:teuthology.orchestra.run.trial112.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:50:27.328 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:50:27.328 INFO:teuthology.task.kernel:Updating grub on trial112 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.328 DEBUG:teuthology.orchestra.run.trial112:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:50:27.395 INFO:teuthology.orchestra.run.trial112.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:50:27.396 DEBUG:teuthology.orchestra.run.trial112:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:50:27.462 INFO:teuthology.orchestra.run.trial112.stdout:/sbin/grubby 2026-02-12T22:50:27.462 INFO:teuthology.orchestra.run.trial112.stdout:yes 2026-02-12T22:50:27.464 DEBUG:teuthology.orchestra.run.trial112:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.475 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T22:50:27.475 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T22:50:27.530 INFO:teuthology.orchestra.run.trial112.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:50:27.531 DEBUG:teuthology.orchestra.run.trial112:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.541 DEBUG:teuthology.orchestra.run.trial154:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:50:27.574 INFO:teuthology.orchestra.run.trial154.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.575 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.576 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.576 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T22:50:27.576 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T22:50:27.576 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T22:50:27.576 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial154.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T22:50:27.576 DEBUG:teuthology.orchestra.run.trial154:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T22:50:27.607 DEBUG:teuthology.orchestra.run.trial112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:50:27.648 INFO:teuthology.orchestra.run.trial154.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.650 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.651 DEBUG:teuthology.orchestra.run.trial154:> sudo rpm -qi grub2-tools 2026-02-12T22:50:27.717 INFO:teuthology.orchestra.run.trial112.stderr:Generating grub configuration file ... 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Name : grub2-tools 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Epoch : 1 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Version : 2.12 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Release : 29.el10_1 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Architecture: x86_64 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Group : Unspecified 2026-02-12T22:50:27.722 INFO:teuthology.orchestra.run.trial154.stdout:Size : 7963769 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:License : GPL-3.0-or-later 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Signature : 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Packager : Release Engineering 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Summary : Support tools for GRUB. 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:Description : 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T22:50:27.723 INFO:teuthology.orchestra.run.trial154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T22:50:27.724 INFO:teuthology.orchestra.run.trial154.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T22:50:27.724 INFO:teuthology.orchestra.run.trial154.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T22:50:27.724 INFO:teuthology.orchestra.run.trial154.stdout:hardware devices. 2026-02-12T22:50:27.724 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T22:50:27.724 INFO:teuthology.orchestra.run.trial154.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T22:50:27.725 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T22:50:27.725 INFO:teuthology.task.kernel:Updating grub on trial154 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.725 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T22:50:27.790 INFO:teuthology.orchestra.run.trial154.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:50:27.792 DEBUG:teuthology.orchestra.run.trial154:> sudo command -v grubby && echo yes || echo no 2026-02-12T22:50:27.858 INFO:teuthology.orchestra.run.trial154.stdout:/sbin/grubby 2026-02-12T22:50:27.859 INFO:teuthology.orchestra.run.trial154.stdout:yes 2026-02-12T22:50:27.860 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-12T22:50:27.894 INFO:teuthology.orchestra.run.trial112.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:50:27.904 INFO:teuthology.orchestra.run.trial112.stderr:done 2026-02-12T22:50:27.906 DEBUG:teuthology.orchestra.run.trial112:> test -d /sys/firmware/efi 2026-02-12T22:50:27.923 DEBUG:teuthology.orchestra.run.trial112:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:50:27.926 INFO:teuthology.orchestra.run.trial154.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-12T22:50:27.927 DEBUG:teuthology.orchestra.run.trial154:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:27.994 INFO:teuthology.orchestra.run.trial112.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:50:27.994 INFO:teuthology.orchestra.run.trial112.stdout:/boot/efi/EFI/rocky 2026-02-12T22:50:27.996 DEBUG:teuthology.orchestra.run.trial112:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:50:28.003 DEBUG:teuthology.orchestra.run.trial154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T22:50:28.062 INFO:teuthology.orchestra.run.trial112.stdout:no 2026-02-12T22:50:28.062 DEBUG:teuthology.orchestra.run.trial112:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:50:28.114 INFO:teuthology.orchestra.run.trial154.stderr:Generating grub configuration file ... 2026-02-12T22:50:28.128 INFO:teuthology.orchestra.run.trial112.stdout:yes 2026-02-12T22:50:28.128 DEBUG:teuthology.orchestra.run.trial112:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:50:28.195 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial112 2026-02-12T22:50:28.195 DEBUG:teuthology.orchestra.run.trial112:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:50:28.260 INFO:teuthology.orchestra.run.trial112.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:50:28.292 INFO:teuthology.orchestra.run.trial154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T22:50:28.302 INFO:teuthology.orchestra.run.trial154.stderr:done 2026-02-12T22:50:28.304 DEBUG:teuthology.orchestra.run.trial154:> test -d /sys/firmware/efi 2026-02-12T22:50:28.322 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T22:50:28.393 INFO:teuthology.orchestra.run.trial154.stdout:/boot/efi/EFI/BOOT 2026-02-12T22:50:28.394 INFO:teuthology.orchestra.run.trial154.stdout:/boot/efi/EFI/rocky 2026-02-12T22:50:28.395 DEBUG:teuthology.orchestra.run.trial154:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T22:50:28.464 INFO:teuthology.orchestra.run.trial154.stdout:no 2026-02-12T22:50:28.464 DEBUG:teuthology.orchestra.run.trial154:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-12T22:50:28.531 INFO:teuthology.orchestra.run.trial154.stdout:yes 2026-02-12T22:50:28.531 DEBUG:teuthology.orchestra.run.trial154:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-12T22:50:28.598 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial154 2026-02-12T22:50:28.598 DEBUG:teuthology.orchestra.run.trial154:> sudo bash -c 'echo pci > /proc/sys/kernel/reboot && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-12T22:50:28.664 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: /proc/sys/kernel/reboot: No such file or directory 2026-02-12T22:50:58.238 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:58.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:50:58.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.334 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:50:58.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:50:58.418 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.419 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:50:58.476 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.476 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.477 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:58.640 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:58.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:50:58.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:58.753 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:50:58.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:50:58.834 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:58.834 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:50:58.893 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:58.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:58.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:58.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:50:59.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:50:59.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:50:59.590 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:50:59.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:50:59.673 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:50:59.673 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:50:59.731 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:50:59.731 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:50:59.732 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:50:59.732 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:50:59.894 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:50:59.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:50:59.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.005 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:00.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:00.091 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.091 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:00.149 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.149 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.149 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:00.733 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:00.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:00.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:00.846 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:00.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:00.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:00.923 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:00.980 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:00.981 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:00.981 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:00.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.150 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:01.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:01.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:01.260 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:01.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:01.347 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:01.347 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:01.405 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:01.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:01.406 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:01.406 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:01.982 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:01.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:01.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.092 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:02.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:02.175 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.175 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:02.233 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.233 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.233 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:02.407 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:02.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:02.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:02.479 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:02.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:02.553 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:02.553 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:02.611 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:02.611 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:02.611 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:02.611 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.234 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:03.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:03.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.346 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:03.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:03.419 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.419 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:03.477 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.477 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.478 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:03.612 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:03.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:03.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:03.722 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:03.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:03.804 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:03.805 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:03.862 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:03.862 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:03.862 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:03.862 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:04.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:04.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.590 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:04.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:04.669 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:04.669 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:04.726 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:04.726 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:04.727 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:04.727 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:04.864 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:04.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:04.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:04.974 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:05.048 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:05.048 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.048 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:05.105 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.105 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.105 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.105 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:05.728 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:05.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:05.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:05.824 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:05.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:05.901 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:05.902 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:05.958 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:05.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:05.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:05.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.106 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:06.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:06.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:06.216 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:06.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:06.291 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:06.291 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:06.348 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:06.348 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:06.349 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:06.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:06.960 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:06.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:06.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.071 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:07.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:07.155 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.155 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:07.213 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:07.350 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:07.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:07.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:07.505 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:07.580 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:07.580 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:07.580 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:07.637 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:07.637 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:07.637 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:07.637 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.215 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:08.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:08.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.327 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:08.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:08.399 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.399 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:08.455 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.456 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.456 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.456 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:08.639 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:08.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:08.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:08.750 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:08.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:08.834 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:08.834 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:08.891 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:08.891 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:08.891 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:08.891 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.458 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:09.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:09.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:09.560 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:09.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:09.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:09.640 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:09.698 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:09.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:09.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:09.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:09.893 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:09.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:09.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.005 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:10.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:10.087 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.088 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:10.145 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.145 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:10.700 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:10.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:10.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:10.810 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:10.887 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:10.888 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:10.888 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:10.945 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:10.945 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:10.946 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:10.946 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:11.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:11.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:11.258 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:11.331 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:11.331 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:11.332 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:11.389 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:11.389 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:11.389 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:11.389 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:11.947 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:11.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:11.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.058 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:12.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:12.133 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.133 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:12.190 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:12.391 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:12.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:12.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:12.503 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:12.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:12.577 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:12.577 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:12.635 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:12.635 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:12.635 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:12.635 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.192 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:13.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:13.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.303 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:13.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:13.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.377 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:13.434 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:13.636 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:13.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:13.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:13.747 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:13.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:13.824 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:13.824 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:13.883 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:13.883 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:13.883 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:13.883 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:14.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:14.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.536 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:14.611 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:14.611 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:14.612 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:14.669 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:14.669 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:14.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:14.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:14.884 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:14.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:14.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:14.994 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:15.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:15.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.066 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:15.124 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.124 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.124 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.124 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:15.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:15.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:15.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:15.780 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:15.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:15.901 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:15.901 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:15.959 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:15.959 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:15.959 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:15.959 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.125 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:16.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:16.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:16.232 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:16.309 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:16.309 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:16.309 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:16.365 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:16.366 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:16.366 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:16.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:16.961 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:16.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:16.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.070 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:17.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:17.152 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.152 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:17.210 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:17.367 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:17.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:17.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:17.477 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:17.557 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:17.558 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:17.558 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:17.615 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:17.615 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:17.616 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:17.616 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.212 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:18.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:18.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.322 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:18.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:18.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.403 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:18.460 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:18.617 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:18.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:18.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:18.728 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:18.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:18.813 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:18.813 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:18.871 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:18.871 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:18.871 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:18.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.462 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:19.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:19.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.575 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:19.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:19.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:19.646 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:19.703 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:19.703 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:19.703 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:19.703 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:19.873 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:19.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:19.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:19.982 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:20.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:20.069 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:20.069 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:20.127 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.127 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.127 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.127 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:20.705 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:20.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:20.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:20.814 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:20.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:20.894 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:20.894 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:20.951 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:20.951 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:20.951 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:20.952 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.129 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:21.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:21.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:21.239 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:21.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:21.320 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:21.320 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:21.376 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:21.377 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:21.377 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:21.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:21.953 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:21.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:21.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.063 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:22.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:22.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.134 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:22.191 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.192 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:22.378 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:22.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:22.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:22.443 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:22.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:22.516 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:22.516 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:22.573 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:22.574 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:22.574 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:22.574 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.193 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:23.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:23.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.257 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:23.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:23.336 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.336 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:23.393 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.394 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.394 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.394 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:23.575 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:23.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:23.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:23.638 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:23.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:23.724 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:23.724 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:23.780 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:23.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:23.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:23.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.395 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:24.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:24.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.506 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:24.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:24.594 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.594 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:24.651 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:24.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:24.651 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:24.652 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:24.782 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:24.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:24.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:24.891 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:24.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:24.975 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:24.975 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:25.033 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:25.033 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:25.033 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:25.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:25.653 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:25.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:25.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:25.763 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:25.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:25.846 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:25.846 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:25.902 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:25.902 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:25.902 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:25.902 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.035 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:26.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:26.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:26.144 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:26.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:26.228 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:26.228 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:26.285 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:26.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:26.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:26.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:26.903 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:26.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:26.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:26.968 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:27.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:27.042 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.042 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:27.100 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.100 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.100 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.100 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:27.288 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:27.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:27.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:27.394 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:27.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:27.477 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:27.478 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:27.534 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:27.534 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:27.535 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:27.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:28.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:28.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.210 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:28.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:28.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.284 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:28.341 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.341 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.341 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:28.536 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:28.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:28.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:28.599 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:28.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:28.685 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:28.685 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:28.742 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:28.742 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:28.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:28.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.342 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:29.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:29.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.415 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:29.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:29.493 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.493 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:29.551 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.551 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.551 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:29.743 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:29.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:29.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:29.851 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:29.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:29.930 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:29.930 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:29.987 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:29.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:29.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:29.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:30.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:30.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:30.662 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:30.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:30.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:30.747 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:30.804 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:30.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:30.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:30.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:30.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:30.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:30.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:31.098 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:31.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:31.172 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.172 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:31.230 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:31.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:31.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:31.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:31.806 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:31.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:31.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:31.912 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:31.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:31.995 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:31.995 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:32.052 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.052 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.053 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:32.232 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:32.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:32.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:32.343 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:32.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:32.420 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:32.421 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:32.478 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:32.478 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:32.479 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:32.479 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.054 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:33.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:33.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.164 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:33.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:33.241 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.241 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:33.298 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.298 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.298 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:33.480 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:33.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:33.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:33.544 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:33.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:33.617 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:33.617 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:33.674 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:33.674 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:33.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:33.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.299 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:34.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:34.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.362 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:34.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:34.442 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.442 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:34.499 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.499 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.499 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.499 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:34.675 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:34.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:34.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:34.785 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:34.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:34.858 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:34.858 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:34.915 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:34.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:34.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:34.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.500 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:35.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:35.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:35.566 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:35.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:35.654 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:35.655 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:35.713 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:35.713 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:35.713 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:35.714 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:35.917 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:35.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:35.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.026 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:36.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:36.105 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.105 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:36.161 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.162 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:36.715 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:36.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:36.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:36.826 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:36.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:36.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:36.911 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:36.968 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:36.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:36.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:36.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.163 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:37.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:37.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:37.228 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:37.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:37.300 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:37.300 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:37.357 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:37.358 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:37.358 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:37.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:37.969 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:37.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:37.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.083 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:38.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:38.173 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.173 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:38.230 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.230 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.230 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.230 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:38.359 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:38.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:38.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:38.453 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:38.535 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:38.535 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:38.535 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:38.591 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:38.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:38.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:38.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:39.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:39.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.302 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:39.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:39.381 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.381 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:39.437 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.437 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:39.592 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:39.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:39.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:39.655 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:39.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:39.727 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:39.727 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:39.785 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:39.785 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:39.785 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:39.785 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:40.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:40.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.557 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:40.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:40.637 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.637 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:40.694 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.694 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.694 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.694 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:40.786 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:40.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:40.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:40.854 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:40.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:40.930 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:40.930 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:40.987 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:40.988 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:40.988 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:40.988 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.695 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:41.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:41.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:41.804 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:41.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:41.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:41.878 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:41.935 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:41.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:41.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:41.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:41.990 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:41.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:41.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:42.096 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:42.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:42.185 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:42.185 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:42.244 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:42.244 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:42.244 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:42.244 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:42.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:42.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:42.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.048 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:43.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:43.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.127 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:43.185 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.185 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.185 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.185 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:43.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:43.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:43.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:43.356 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:43.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:43.430 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:43.430 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:43.487 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:43.488 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:43.488 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:43.488 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.186 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:44.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:44.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.297 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:44.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:44.380 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.380 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:44.437 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:44.490 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:44.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:44.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:44.599 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:44.683 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:44.683 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:44.683 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:44.740 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:44.741 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:44.741 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:44.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:45.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:45.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.549 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:45.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:45.622 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.622 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:45.679 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.680 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:45.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:45.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:45.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:45.851 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:45.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:45.936 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:45.936 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:45.994 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:45.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:45.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:45.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.681 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:46.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:46.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:46.792 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:46.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:46.872 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:46.872 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:46.929 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:46.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:46.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:46.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:46.996 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:46.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:46.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:47.105 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:47.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:47.182 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:47.182 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:47.238 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:47.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:47.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:47.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:47.931 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:47.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:47.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.042 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:48.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:48.122 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.122 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:48.181 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.181 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.181 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:48.240 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:48.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:48.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:48.349 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:48.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:48.427 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:48.427 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:48.484 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:48.484 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:48.484 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:48.484 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.182 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:49.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:49.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.293 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:49.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:49.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.377 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:49.434 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:49.485 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:49.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:49.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:49.594 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:49.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:49.677 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:49.677 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:49.736 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:49.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:49.737 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:49.737 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:50.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:50.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.509 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:50.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:50.596 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.596 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:50.653 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.653 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.653 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.653 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:50.738 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:50.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:50.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:50.849 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:50.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:50.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:50.922 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:50.980 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:50.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:50.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:50.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.655 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:51.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:51.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:51.765 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:51.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:51.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:51.839 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:51.896 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:51.896 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:51.897 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:51.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:51.982 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:51.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:51.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:52.091 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:52.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:52.171 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:52.171 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:52.228 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:52.228 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:52.228 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:52.228 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:52.898 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:52.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:52.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.011 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:53.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:53.100 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.100 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:53.157 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:53.230 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:53.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:53.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:53.340 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:53.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:53.424 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:53.424 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:53.481 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:53.482 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:53.482 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:53.482 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.159 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:54.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:54.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.271 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:54.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:54.348 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.348 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:54.408 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.408 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.408 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.408 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:54.483 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:54.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:54.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:54.583 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:54.663 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:54.663 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:54.663 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:54.720 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:54.720 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:54.720 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:54.720 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.410 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:55.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:55.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.522 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:55.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:55.594 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.594 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:55.651 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.651 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.651 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:55.722 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:55.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:55.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:55.824 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:55.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:55.902 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:55.902 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:55.960 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:55.960 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:55.960 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:55.961 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.652 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:56.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:56.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:56.765 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:56.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:56.850 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:56.850 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:56.907 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:56.907 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:56.907 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:56.908 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:56.962 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:56.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:56.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:57.071 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:57.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:57.144 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:57.144 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:57.201 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:57.202 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:57.202 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:57.202 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:57.909 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:57.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:57.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.021 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:58.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:58.103 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.103 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:58.160 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.160 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.160 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.160 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:58.204 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:58.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:58.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:58.314 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:58.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:58.401 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:58.401 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:58.458 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:58.458 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:58.458 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:58.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:51:59.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:59.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.272 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:51:59.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:51:59.347 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.347 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:51:59.404 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:51:59.459 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:51:59.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:59.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:51:59.568 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:51:59.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:51:59.657 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:51:59.657 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:51:59.714 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:51:59.715 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:51:59.715 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:51:59.715 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.406 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:00.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:00.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.518 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:00.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:00.603 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.603 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:00.660 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.660 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:00.717 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:00.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:00.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:00.825 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:00.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:00.912 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:00.913 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:00.970 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:00.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:00.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:00.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:01.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:01.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:01.771 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:01.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:01.854 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:01.854 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:01.912 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:01.912 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:01.913 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:01.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:01.972 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:01.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:01.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:02.081 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:02.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:02.157 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:02.157 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:02.215 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:02.215 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:02.215 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:02.215 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:02.914 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:02.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:02.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.024 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:03.095 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:03.096 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.096 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:03.154 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.154 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.154 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:03.216 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:03.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:03.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:03.325 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:03.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:03.402 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:03.402 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:03.460 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:03.461 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:03.461 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:03.461 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:04.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:04.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.267 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:04.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:04.341 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.341 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:04.398 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:04.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:04.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:04.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:04.572 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:04.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:04.648 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:04.648 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:04.705 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:04.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:04.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:04.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.401 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:05.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:05.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.470 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:05.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:05.552 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.552 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:05.610 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.610 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.610 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.610 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:05.707 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:05.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:05.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:05.817 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:05.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:05.903 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:05.904 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:05.961 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:05.962 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:05.962 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:05.962 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.611 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:06.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:06.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:06.722 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:06.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:06.806 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:06.806 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:06.863 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:06.863 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:06.863 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:06.863 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:06.963 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:06.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:06.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.073 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:07.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:07.156 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:07.156 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:07.212 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:07.213 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:07.213 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:07.213 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:07.865 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:07.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:07.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:07.976 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:08.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:08.055 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.055 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:08.112 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.112 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.112 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.112 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:08.214 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:08.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:08.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:08.325 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:08.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:08.415 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:08.415 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:08.473 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:08.474 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:08.474 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:08.474 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.114 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:09.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:09.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.225 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:09.300 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:09.300 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.300 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:09.357 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.357 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.357 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:09.475 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:09.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:09.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:09.584 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:09.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:09.670 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:09.670 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:09.727 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:09.728 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:09.728 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:09.728 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.359 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:10.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:10.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.468 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:10.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:10.554 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.554 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:10.611 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.612 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.612 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.612 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:10.729 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:10.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:10.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:10.844 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:10.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:10.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:10.934 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:10.992 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:10.992 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:10.992 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:10.992 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.613 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:11.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:11.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:11.724 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:11.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:11.808 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:11.808 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:11.865 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:11.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:11.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:11.866 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:11.994 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:11.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:11.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.103 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:12.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:12.178 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:12.178 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:12.235 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:12.236 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:12.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:12.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:12.866 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:12.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:12.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:12.977 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:13.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:13.053 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.053 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:13.109 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.110 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.110 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.110 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:13.237 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:13.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:13.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:13.348 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:13.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:13.431 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:13.431 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:13.488 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:13.489 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:13.489 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:13.489 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.111 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:14.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:14.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.175 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:14.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:14.253 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.253 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:14.310 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:14.310 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:14.310 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:14.310 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:14.491 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:14.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:14.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:14.601 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:14.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:14.676 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:14.676 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:14.733 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:14.733 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:14.733 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:14.733 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.312 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:15.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:15.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.425 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:15.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:15.499 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.499 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:15.556 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.557 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.557 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:15.735 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:15.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:15.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:15.846 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:15.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:15.930 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:15.930 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:15.987 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:15.987 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:15.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:15.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.559 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:16.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:16.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:16.669 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:16.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:16.744 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:16.745 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:16.802 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:16.802 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:16.802 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:16.802 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:16.989 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:16.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:16.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.100 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:17.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:17.185 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.185 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:17.242 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:17.242 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:17.242 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:17.243 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:17.803 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:17.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:17.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:17.886 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:17.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:17.969 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:17.969 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:18.026 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.026 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.026 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:18.244 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:18.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:18.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:18.354 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:18.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:18.445 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:18.445 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:18.501 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:18.502 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:18.502 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:18.502 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:19.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:19.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.138 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:19.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:19.221 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.221 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:19.278 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.278 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.279 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.279 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:19.503 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:19.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:19.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:19.614 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:19.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:19.694 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:19.694 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:19.752 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:19.753 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:19.753 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:19.753 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.280 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:20.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:20.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.393 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:20.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:20.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.469 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:20.526 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:20.527 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:20.527 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:20.527 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:20.755 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:20.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:20.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:20.865 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:20.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:20.948 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:20.948 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:21.005 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.005 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.005 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.005 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:21.528 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:21.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:21.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:21.639 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:21.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:21.721 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:21.722 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:21.779 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:21.780 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:21.780 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:21.780 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.007 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:22.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:22.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.117 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:22.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:22.204 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.204 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:22.261 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:22.261 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:22.262 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:22.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:22.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:22.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:22.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:22.891 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:22.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:22.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:22.973 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:23.030 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.030 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.030 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.030 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:23.263 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:23.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:23.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:23.374 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:23.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:23.449 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:23.450 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:23.508 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:23.508 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:23.508 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:23.508 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.031 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:24.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:24.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.145 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:24.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:24.231 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.231 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:24.288 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.288 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:24.510 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:24.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:24.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:24.608 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:24.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:24.686 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:24.686 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:24.743 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:24.743 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:24.743 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:24.743 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:25.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:25.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.373 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:25.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:25.447 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.447 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:25.504 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.504 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.504 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.504 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:25.744 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:25.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:25.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:25.854 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:25.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:25.939 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:25.939 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:25.996 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:25.996 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:25.997 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:25.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.506 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:26.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:26.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:26.617 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:26.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:26.699 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:26.699 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:26.756 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:26.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:26.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:26.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:26.998 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:26.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:26.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.109 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:27.187 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:27.187 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.187 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:27.246 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:27.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:27.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:27.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:27.846 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:27.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:27.921 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:27.921 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:27.979 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:27.979 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:27.979 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:27.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.247 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:28.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:28.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:28.364 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:28.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:28.438 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:28.438 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:28.496 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:28.496 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:28.496 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:28.496 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:28.980 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:28.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:28.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.089 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:29.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:29.165 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.165 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:29.222 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:29.497 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:29.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:29.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:29.607 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:29.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:29.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:29.682 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:29.739 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:29.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:29.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:29.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.223 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:30.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:30.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.335 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:30.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:30.407 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.408 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:30.464 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.464 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.464 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.464 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:30.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:30.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:30.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:30.840 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:30.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:30.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:30.922 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:30.980 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:30.981 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:30.981 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:30.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.465 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:31.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:31.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:31.575 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:31.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:31.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:31.648 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:31.705 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:31.705 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:31.705 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:31.705 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:31.982 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:31.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:31.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.076 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:32.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:32.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.163 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:32.221 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.222 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.222 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.222 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:32.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:32.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:32.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:32.817 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:32.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:32.898 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:32.898 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:32.956 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:32.956 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:32.956 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:32.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.223 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:33.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:33.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:33.321 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:33.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:33.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:33.400 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:33.457 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:33.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:33.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:33.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:33.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:33.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:33.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.066 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:34.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:34.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.148 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:34.206 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.206 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.206 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.206 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:34.459 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:34.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:34.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:34.549 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:34.622 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:34.622 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:34.622 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:34.679 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:34.679 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:34.680 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:34.680 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.208 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:35.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:35.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.272 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:35.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:35.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.356 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:35.413 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.414 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.414 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.414 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:35.681 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:35.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:35.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:35.791 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:35.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:35.874 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:35.874 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:35.931 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:35.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:35.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:35.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.415 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:36.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:36.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.525 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:36.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:36.601 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:36.601 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:36.658 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:36.658 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:36.658 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:36.658 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:36.934 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:36.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:36.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:36.996 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:37.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:37.087 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.088 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:37.145 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.146 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.146 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.146 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:37.659 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:37.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:37.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:37.770 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:37.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:37.857 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:37.857 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:37.914 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:37.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:37.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:37.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.147 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:38.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:38.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:38.258 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:38.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:38.329 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:38.329 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:38.386 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:38.386 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:38.386 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:38.387 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:38.916 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:38.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:38.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.027 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:39.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:39.104 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.104 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:39.161 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.161 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.161 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.161 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:39.388 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:39.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:39.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:39.498 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:39.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:39.571 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:39.571 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:39.627 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:39.627 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:39.628 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:39.628 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.163 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:40.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:40.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.274 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:40.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:40.356 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.356 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:40.413 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.413 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.413 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.413 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:40.628 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:40.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:40.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:40.691 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:40.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:40.770 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:40.770 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:40.826 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:40.826 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:40.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:40.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.414 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:41.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:41.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.527 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:41.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:41.603 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:41.603 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:41.660 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:41.660 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:41.660 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:41.661 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:41.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:41.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:41.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:41.938 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:42.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:42.012 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.013 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:42.070 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.070 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.070 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.070 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:42.662 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:42.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:42.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:42.772 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:42.857 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:42.858 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:42.858 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:42.915 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:42.915 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:42.915 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:42.915 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.071 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:43.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:43.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:43.181 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:43.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:43.255 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:43.255 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:43.312 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:43.313 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:43.313 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:43.313 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:43.916 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:43.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:43.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.027 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:44.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:44.115 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.115 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:44.172 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.172 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.173 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:44.314 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:44.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:44.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:44.425 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:44.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:44.515 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:44.515 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:44.572 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:44.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:44.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:44.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.174 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:45.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:45.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.285 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:45.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:45.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.358 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:45.416 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.416 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.416 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.416 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:45.574 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:45.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:45.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:45.684 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:45.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:45.768 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:45.769 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:45.826 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:45.827 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:45.827 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:45.827 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.418 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:46.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:46.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.507 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:46.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:46.583 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:46.583 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:46.639 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:46.639 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:46.640 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:46.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:46.828 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:46.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:46.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:46.937 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:47.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:47.024 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.024 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:47.081 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.081 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.081 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.081 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:47.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:47.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:47.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:47.740 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:47.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:47.815 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:47.815 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:47.872 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:47.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:47.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:47.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.083 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:48.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:48.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.193 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:48.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:48.276 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:48.277 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:48.334 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:48.335 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:48.335 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:48.335 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:48.874 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:48.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:48.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:48.984 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:49.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:49.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.060 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:49.117 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:49.336 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:49.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:49.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:49.448 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:49.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:49.534 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:49.534 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:49.591 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:49.592 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:49.592 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:49.592 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.118 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:50.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:50.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.229 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:50.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:50.306 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.306 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:50.363 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.363 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.363 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.363 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:50.593 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:50.594 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:50.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:50.704 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:50.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:50.782 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:50.782 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:50.839 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:50.839 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:50.840 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:50.840 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.364 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:51.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:51.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.474 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:51.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:51.563 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:51.563 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:51.619 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:51.620 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:51.620 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:51.620 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:51.841 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:51.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:51.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:51.952 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:52.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:52.029 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.030 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:52.087 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.087 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.087 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:52.620 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:52.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:52.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:52.725 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:52.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:52.801 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:52.801 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:52.859 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:52.860 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:52.860 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:52.860 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.088 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:53.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:53.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.198 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:53.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:53.268 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:53.268 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:53.325 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:53.326 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:53.326 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:53.326 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:53.861 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:53.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:53.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:53.973 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:54.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:54.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.060 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:54.117 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.117 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.118 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.118 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:54.327 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:54.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:54.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:54.438 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:54.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:54.519 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:54.520 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:54.576 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:54.577 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:54.577 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:54.577 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.119 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:55.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:55.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.207 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:55.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:55.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.284 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:55.340 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.340 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:55.579 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:55.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:55.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:55.658 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:55.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:55.747 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:55.747 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:55.804 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:55.805 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:55.805 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:55.805 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.342 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:56.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:56.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.452 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:56.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:56.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:56.538 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:56.596 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:56.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:56.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:56.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:56.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:56.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:56.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:56.918 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:57.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:57.002 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.002 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:57.059 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.059 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.059 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:57.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:57.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:57.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:57.672 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:57.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:57.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:57.746 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:57.803 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:57.804 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:57.804 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:57.804 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.060 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:58.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:58.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.171 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:58.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:58.247 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.247 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:58.304 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:58.305 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:58.305 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:58.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:58.805 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:52:58.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:58.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:58.915 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:52:58.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:52:58.997 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:58.997 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:52:59.054 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.054 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.055 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.055 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:52:59.306 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:52:59.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:59.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:52:59.416 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:52:59.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:52:59.497 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:52:59.497 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:52:59.555 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:52:59.555 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:52:59.555 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:52:59.555 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:00.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:00.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.163 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:00.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:00.245 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.246 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:00.303 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.304 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.304 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.304 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:00.557 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:00.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:00.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:00.638 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:00.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:00.724 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:00.724 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:00.781 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:00.781 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:00.781 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:00.781 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.305 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:01.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:01.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.395 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:01.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:01.487 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.487 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:01.544 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:01.544 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:01.544 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:01.544 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:01.783 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:01.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:01.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:01.893 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:01.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:01.969 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:01.969 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:02.026 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.027 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.027 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.027 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:02.546 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:02.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:02.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:02.625 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:02.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:02.703 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:02.703 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:02.759 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:02.759 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:02.759 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:02.759 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.028 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:03.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:03.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.108 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:03.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:03.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.189 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:03.246 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:03.246 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:03.246 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:03.246 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:03.760 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:03.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:03.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:03.873 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:03.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:03.959 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:03.959 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:04.016 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.016 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.016 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.016 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:04.247 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:04.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:04.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:04.357 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:04.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:04.432 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:04.432 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:04.490 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:04.490 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:04.490 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:04.490 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.018 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:05.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:05.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.126 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:05.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:05.205 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.205 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:05.262 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.263 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.263 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.263 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:05.491 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:05.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:05.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:05.600 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:05.672 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:05.672 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:05.672 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:05.729 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:05.730 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:05.730 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:05.730 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.265 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:06.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:06.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.375 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:06.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:06.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.456 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:06.514 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.514 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.515 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.515 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:06.731 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:06.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:06.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:06.843 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:06.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:06.918 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:06.918 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:06.976 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:06.976 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:06.976 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:06.976 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.516 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:07.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:07.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:07.616 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:07.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:07.699 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:07.700 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:07.757 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:07.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:07.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:07.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:07.978 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:07.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:07.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.087 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:08.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:08.173 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.173 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:08.230 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.231 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.231 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.231 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:08.759 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:08.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:08.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:08.848 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:08.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:08.926 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:08.926 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:08.983 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:08.983 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:08.983 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:08.983 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.232 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:09.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:09.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:09.342 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:09.429 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:09.429 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:09.429 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:09.487 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:09.487 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:09.487 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:09.487 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:09.985 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:09.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:09.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.058 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:10.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:10.133 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.133 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:10.190 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.190 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:10.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:10.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:10.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:10.602 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:10.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:10.687 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:10.687 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:10.745 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:10.746 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:10.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:10.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.191 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:11.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:11.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.306 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:11.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:11.388 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.388 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:11.446 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:11.747 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:11.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:11.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:11.859 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:11.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:11.936 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:11.936 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:11.993 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:11.994 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:11.994 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:11.994 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.447 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:12.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:12.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:12.557 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:12.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:12.639 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:12.640 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:12.697 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:12.697 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:12.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:12.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:12.996 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:12.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:12.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.105 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:13.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:13.181 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.182 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:13.238 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:13.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:13.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:13.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:13.808 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:13.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:13.893 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:13.893 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:13.950 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:13.950 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:13.950 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:13.950 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.240 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:14.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:14.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:14.350 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:14.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:14.435 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:14.436 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:14.492 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:14.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:14.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:14.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:14.951 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:14.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:14.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.064 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:15.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:15.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.139 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:15.197 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:15.494 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:15.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:15.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:15.606 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:15.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:15.682 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:15.683 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:15.740 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:15.740 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:15.740 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:15.740 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:16.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:16.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.316 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:16.396 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:16.396 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.397 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:16.454 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.454 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.455 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:16.742 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:16.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:16.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:16.853 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:16.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:16.929 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:16.930 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:16.986 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:16.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:16.987 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:16.987 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:17.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:17.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:17.570 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:17.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:17.643 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:17.643 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:17.700 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:17.700 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:17.700 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:17.700 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:17.988 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:17.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:17.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.103 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:18.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:18.177 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.178 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:18.234 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.235 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.235 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.235 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:18.702 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:18.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:18.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:18.812 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:18.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:18.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:18.886 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:18.943 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:18.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:18.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:18.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.236 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:19.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:19.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:19.346 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:19.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:19.428 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:19.428 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:19.485 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:19.486 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:19.486 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:19.486 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:19.945 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:19.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:19.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.058 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:20.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:20.143 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.143 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:20.200 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.201 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.201 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.201 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:20.488 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:20.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:20.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:20.601 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:20.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:20.678 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:20.678 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:20.735 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:20.736 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:20.736 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:20.736 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.202 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:21.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:21.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.313 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:21.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:21.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.385 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:21.443 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.443 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.443 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.443 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:21.737 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:21.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:21.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:21.847 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:21.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:21.934 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:21.934 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:21.992 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:21.993 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:21.993 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:21.993 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.444 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:22.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:22.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:22.514 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:22.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:22.592 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:22.592 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:22.649 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:22.649 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:22.650 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:22.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:22.994 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:22.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:22.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.057 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:23.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:23.138 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.138 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:23.195 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.196 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.196 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:23.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:23.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:23.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:23.759 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:23.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:23.837 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:23.837 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:23.893 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:23.893 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:23.893 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:23.893 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:24.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:24.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:24.306 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:24.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:24.380 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:24.380 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:24.437 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:24.438 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:24.438 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:24.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:24.894 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:24.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:24.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.005 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:25.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:25.093 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.094 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:25.151 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.151 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.151 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.151 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:25.440 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:25.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:25.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:25.551 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:25.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:25.627 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:25.627 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:25.684 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:25.685 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:25.685 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:25.685 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.152 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:26.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:26.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.234 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:26.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:26.314 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.314 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:26.371 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.371 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.371 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.371 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:26.686 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:26.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:26.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:26.796 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:26.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:26.877 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:26.878 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:26.935 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:26.935 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:26.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:26.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.373 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:27.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:27.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:27.482 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:27.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:27.565 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:27.565 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:27.622 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:27.622 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:27.623 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:27.623 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:27.937 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:27.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:27.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.047 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:28.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:28.121 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.121 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:28.178 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.179 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:28.624 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:28.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:28.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:28.733 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:28.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:28.817 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:28.817 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:28.874 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:28.874 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:28.874 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:28.874 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.180 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:29.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:29.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.291 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:29.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:29.381 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:29.381 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:29.439 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:29.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:29.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:29.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:29.875 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:29.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:29.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:29.988 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:30.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:30.071 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.071 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:30.129 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:30.441 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:30.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:30.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:30.551 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:30.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:30.633 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:30.633 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:30.690 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:30.691 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:30.691 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:30.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.131 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:31.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:31.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.241 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:31.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:31.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.317 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:31.374 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.374 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.374 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.374 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:31.692 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:31.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:31.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:31.802 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:31.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:31.891 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:31.891 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:31.949 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:31.949 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:31.949 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:31.949 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:32.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:32.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:32.473 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:32.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:32.556 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:32.556 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:32.613 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:32.614 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:32.614 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:32.614 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:32.951 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:32.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:32.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.062 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:33.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:33.141 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.141 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:33.197 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:33.616 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:33.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:33.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:33.726 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:33.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:33.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:33.810 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:33.867 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:33.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:33.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:33.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.199 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:34.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:34.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.309 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:34.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:34.384 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:34.384 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:34.441 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:34.442 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:34.442 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:34.442 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:34.869 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:34.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:34.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:34.977 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:35.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:35.056 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.056 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:35.113 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.114 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.114 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:35.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:35.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:35.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:35.554 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:35.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:35.632 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:35.632 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:35.689 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:35.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:35.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:35.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:36.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:36.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.178 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:36.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:36.262 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.262 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:36.318 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.318 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.318 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.318 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:36.690 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:36.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:36.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:36.801 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:36.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:36.881 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:36.881 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:36.939 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:36.939 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:36.939 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:36.939 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.319 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:37.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:37.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:37.383 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:37.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:37.456 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:37.456 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:37.513 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:37.514 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:37.514 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:37.514 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:37.940 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:37.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:37.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.050 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:38.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:38.133 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.133 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:38.191 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.191 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.192 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.192 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:38.515 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:38.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:38.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:38.625 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:38.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:38.699 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:38.699 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:38.756 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:38.757 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:38.757 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:38.757 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.193 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:39.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:39.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.305 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:39.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:39.387 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.387 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:39.445 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:39.445 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:39.445 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:39.445 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:39.758 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:39.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:39.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:39.866 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:39.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:39.942 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:39.943 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:40.000 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.000 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.000 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.000 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:40.446 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:40.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:40.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:40.556 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:40.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:40.643 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:40.643 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:40.700 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:40.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:40.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:40.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.002 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:41.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:41.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.109 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:41.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:41.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.190 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:41.247 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:41.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:41.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:41.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:41.812 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:41.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:41.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:41.884 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:41.940 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:41.941 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:41.941 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:41.941 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:42.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:42.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:42.360 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:42.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:42.435 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:42.435 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:42.492 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:42.492 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:42.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:42.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:42.943 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:42.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:42.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.053 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:43.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:43.142 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.142 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:43.199 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.200 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.200 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.200 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:43.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:43.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:43.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:43.604 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:43.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:43.688 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:43.688 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:43.745 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:43.745 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:43.746 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:43.746 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:44.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:44.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.315 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:44.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:44.400 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.400 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:44.456 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.457 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.457 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.457 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:44.747 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:44.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:44.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:44.857 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:44.933 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:44.933 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:44.933 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:44.990 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:44.990 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:44.991 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:44.991 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.458 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:45.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:45.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:45.568 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:45.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:45.644 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:45.644 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:45.700 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:45.701 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:45.701 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:45.701 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:45.992 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:45.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:45.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.104 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:46.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:46.177 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:46.177 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:46.234 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.234 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.234 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.235 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:46.702 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:46.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:46.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:46.812 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:46.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:46.898 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:46.898 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:46.956 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:46.957 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:46.957 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:46.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:47.236 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:47.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:47.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:47.346 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:47.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:47.435 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:47.435 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:47.492 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:47.493 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:47.493 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:47.493 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:47.958 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:47.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:47.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.069 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:48.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:48.151 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.151 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:48.210 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.210 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.210 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.210 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:48.494 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:48.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:48.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:48.605 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:48.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:48.687 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:48.687 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:48.744 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:48.744 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:48.744 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:48.744 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.212 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:49.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:49.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.322 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:49.408 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:49.408 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.408 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:49.465 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:49.466 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:49.466 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:49.466 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:49.745 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:49.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:49.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:49.855 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:49.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:49.943 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:49.943 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:50.000 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.001 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.001 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:50.467 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:50.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:50.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:50.577 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:50.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:50.660 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:50.660 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:50.718 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:50.718 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:50.718 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:50.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.002 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:51.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:51.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:51.113 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:51.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:51.191 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:51.191 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:51.248 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:51.248 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:51.249 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:51.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:51.719 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:51.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:51.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:51.830 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:51.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:51.910 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:51.910 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:51.967 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:51.968 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:51.968 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:51.968 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:52.251 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:52.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:52.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:52.313 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:52.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:52.388 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:52.388 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:52.446 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:52.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:52.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:52.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:52.970 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:52.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:52.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.080 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:53.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:53.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.163 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:53.220 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.220 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.220 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:53.447 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:53.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:53.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:53.558 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:53.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:53.636 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:53.636 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:53.693 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:53.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:53.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:53.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.221 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:54.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:54.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.288 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:54.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:54.364 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.364 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:54.421 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:54.694 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:54.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:54.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:54.800 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:54.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:54.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:54.885 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:54.942 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:54.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:54.943 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:54.943 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.423 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:55.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:55.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:55.534 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:55.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:55.613 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:55.613 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:55.670 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:55.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:55.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:55.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:55.944 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:55.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:55.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:56.054 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:56.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:56.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:56.139 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:56.196 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:56.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:56.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:56.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:56.671 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:56.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:56.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:56.783 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:56.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:56.862 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:56.863 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:56.920 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:56.920 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:56.920 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:56.921 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:57.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:57.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:57.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:57.304 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:57.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:57.389 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:57.389 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:57.447 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:57.447 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:57.447 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:57.447 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:57.921 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:57.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:57.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.031 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:58.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:58.108 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.108 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:58.166 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.167 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.167 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:58.448 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:58.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:58.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:58.556 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:58.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:58.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:58.629 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:58.688 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:58.689 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:58.689 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:58.689 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.168 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:53:59.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:59.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.278 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:53:59.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:53:59.362 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.362 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:53:59.420 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:53:59.690 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:53:59.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:59.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:53:59.802 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:53:59.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:53:59.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:53:59.886 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:53:59.943 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:53:59.943 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:53:59.944 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:53:59.944 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:00.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:00.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:00.531 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:00.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:00.608 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:00.608 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:00.665 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:00.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:00.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:00.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:00.944 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:00.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:00.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.054 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:01.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:01.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:01.139 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:01.196 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:01.197 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:01.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:01.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:01.667 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:01.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:01.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:01.777 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:01.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:01.866 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:01.866 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:01.925 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:01.925 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:01.925 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:01.925 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:02.199 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:02.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:02.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:02.308 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:02.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:02.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:02.385 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:02.443 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:02.444 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:02.444 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:02.444 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:02.926 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:02.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:02.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.038 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:03.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:03.127 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.128 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:03.184 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.184 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.184 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.184 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:03.445 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:03.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:03.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:03.558 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:03.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:03.635 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:03.636 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:03.692 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:03.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:03.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:03.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.186 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:04.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:04.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.296 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:04.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:04.378 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.378 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:04.435 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.436 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.436 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.436 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:04.694 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:04.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:04.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:04.805 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:04.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:04.878 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:04.878 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:04.934 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:04.934 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:04.935 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:04.935 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.437 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:05.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:05.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:05.547 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:05.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:05.620 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:05.620 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:05.678 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:05.678 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:05.678 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:05.679 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:05.936 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:05.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:05.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.046 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:06.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:06.120 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.121 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:06.177 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.178 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.178 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.178 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:06.679 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:06.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:06.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:06.791 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:06.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:06.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:06.872 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:06.929 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:06.929 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:06.930 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:06.930 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.179 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:07.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:07.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:07.290 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:07.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:07.364 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:07.364 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:07.421 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:07.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:07.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:07.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:07.931 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:07.932 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:07.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.041 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:08.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:08.124 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.124 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:08.181 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.181 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.182 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:08.422 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:08.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:08.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:08.532 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:08.608 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:08.609 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:08.609 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:08.666 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:08.666 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:08.666 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:08.666 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:09.183 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:09.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:09.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:09.293 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:09.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:09.367 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.367 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:09.424 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.425 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.425 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.425 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:09.667 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:09.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:09.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:09.778 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:09.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:09.850 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:09.850 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:09.908 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:09.909 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:09.909 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:09.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.426 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:10.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:10.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:10.535 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:10.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:10.625 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:10.625 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:10.683 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:10.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:10.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:10.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:10.911 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:10.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:10.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.021 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:11.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:11.101 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.101 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:11.159 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.159 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.159 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.159 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:11.684 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:11.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:11.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:11.795 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:11.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:11.880 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:11.881 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:11.936 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:11.937 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:11.937 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:11.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:12.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:12.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:12.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:12.270 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:12.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:12.355 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:12.355 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:12.411 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:12.412 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:12.412 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:12.412 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:12.938 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:12.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:12.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:13.048 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:13.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:13.141 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:13.141 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:13.198 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:13.198 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:13.198 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:13.198 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:13.414 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:13.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:13.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:13.522 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:13.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:13.593 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:13.593 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:13.651 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:13.651 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:13.651 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:13.651 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:14.199 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:14.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:14.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:14.311 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:14.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:14.388 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.388 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:14.445 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.446 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.446 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.446 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:14.652 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:14.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:14.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:14.762 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:14.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:14.833 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:14.833 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:14.891 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:14.892 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:14.892 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:14.892 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.447 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:15.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:15.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:15.559 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:15.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:15.636 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:15.636 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:15.692 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:15.693 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:15.693 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:15.693 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:15.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:15.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:15.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.003 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:16.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:16.078 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.078 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:16.136 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.137 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:16.695 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:16.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:16.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:16.806 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:16.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:16.884 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:16.884 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:16.942 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:16.942 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:16.942 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:16.942 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.138 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:17.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:17.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:17.249 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:17.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:17.325 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:17.325 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:17.381 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:17.382 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:17.382 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:17.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:17.944 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:17.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:17.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:18.056 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:18.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:18.139 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:18.139 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:18.196 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:18.196 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.197 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:18.197 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:18.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:18.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:18.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:18.447 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:18.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:18.526 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:18.526 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:18.583 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:18.584 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:18.584 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:18.584 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:19.198 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:19.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:19.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:19.308 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:19.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:19.383 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.383 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:19.440 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.441 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.441 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.441 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:19.585 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:19.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:19.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:19.696 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:19.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:19.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:19.778 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:19.836 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:19.836 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:19.836 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:19.836 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.443 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:20.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:20.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.553 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:20.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:20.626 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:20.626 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:20.683 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:20.684 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:20.684 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:20.684 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:20.838 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:20.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:20.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:20.948 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:21.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:21.021 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.021 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:21.079 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.079 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.079 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.079 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:21.685 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:21.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:21.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:21.795 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:21.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:21.866 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:21.867 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:21.924 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:21.924 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:21.924 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:21.924 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.081 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:22.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:22.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:22.190 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:22.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:22.271 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:22.271 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:22.328 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:22.329 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:22.329 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:22.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:22.925 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:22.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:22.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:23.039 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:23.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:23.116 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:23.116 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:23.173 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:23.174 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:23.174 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:23.174 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:23.330 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:23.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:23.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:23.434 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:23.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:23.513 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:23.513 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:23.571 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:23.572 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:23.572 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:23.572 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:24.175 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:24.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:24.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:24.285 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:24.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:24.362 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.362 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:24.420 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.421 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.421 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.421 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:24.573 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:24.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:24.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:24.683 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:24.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:24.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:24.759 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:24.817 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:24.817 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:24.817 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:24.817 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.422 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:25.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:25.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.532 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:25.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:25.615 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:25.615 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:25.672 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:25.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:25.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:25.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:25.819 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:25.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:25.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:25.929 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:26.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:26.006 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.006 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:26.064 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.064 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.064 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.064 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:26.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:26.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:26.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:26.784 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:26.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:26.865 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:26.866 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:26.922 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:26.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:26.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:26.923 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.066 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:27.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:27.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:27.176 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:27.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:27.255 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:27.255 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:27.311 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:27.312 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:27.312 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:27.312 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:27.924 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:27.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:27.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.035 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:28.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:28.111 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:28.112 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:28.168 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:28.169 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:28.169 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:28.169 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:28.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:28.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:28.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:28.423 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:28.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:28.498 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:28.499 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:28.556 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:28.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:28.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:28.557 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:29.170 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:29.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:29.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:29.282 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:29.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:29.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.359 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:29.416 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.417 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.417 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:29.558 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:29.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:29.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:29.637 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:29.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:29.716 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:29.716 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:29.772 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:29.772 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:29.773 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:29.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.418 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:30.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:30.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.496 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:30.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:30.576 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.576 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:30.633 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.633 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.633 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.633 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:30.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:30.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:30.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:30.851 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:30.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:30.930 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:30.930 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:30.986 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:30.986 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:30.986 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:30.986 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.634 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:31.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:31.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:31.712 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:31.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:31.798 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:31.798 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:31.855 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:31.855 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:31.855 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:31.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:31.987 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:31.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:31.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.065 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:32.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:32.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:32.134 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:32.190 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:32.190 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:32.190 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:32.191 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:32.856 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:32.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:32.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:32.934 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:33.022 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:33.023 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:33.023 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:33.080 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:33.080 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:33.080 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:33.080 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:33.192 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:33.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:33.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:33.301 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:33.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:33.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:33.378 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:33.434 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:33.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:33.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:33.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:34.081 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:34.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:34.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:34.190 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:34.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:34.270 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.270 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:34.328 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.328 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.328 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.328 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:34.436 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:34.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:34.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:34.546 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:34.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:34.629 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:34.629 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:34.687 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:34.687 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:34.687 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:34.687 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.330 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:35.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:35.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.441 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:35.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:35.520 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.520 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:35.577 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.578 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.578 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.578 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:35.689 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:35.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:35.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:35.797 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:35.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:35.873 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:35.873 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:35.931 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:35.931 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:35.931 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:35.931 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.580 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:36.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:36.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:36.691 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:36.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:36.780 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:36.780 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:36.837 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:36.838 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:36.838 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:36.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:36.933 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:36.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:36.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.042 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:37.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:37.117 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:37.117 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:37.174 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:37.175 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:37.175 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:37.175 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:37.840 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:37.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:37.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:37.950 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:38.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:38.027 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:38.027 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:38.084 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:38.084 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:38.085 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:38.085 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:38.176 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:38.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:38.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:38.284 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:38.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:38.365 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:38.365 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:38.422 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:38.422 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:38.423 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:38.423 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.086 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:39.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:39.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:39.196 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:39.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:39.280 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:39.281 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:39.338 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:39.339 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:39.339 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:39.339 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:39.424 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:39.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:39.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:39.533 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:39.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:39.612 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:39.612 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:39.669 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:39.670 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:39.670 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:39.670 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:40.340 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:40.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:40.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:40.451 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:40.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:40.525 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:40.525 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:40.582 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:40.583 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:40.583 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:40.583 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:40.671 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:40.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:40.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:40.738 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:40.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:40.811 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:40.812 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:40.869 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:40.869 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:40.869 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:40.869 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:41.584 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:41.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:41.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:41.694 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:41.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:41.772 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:41.772 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:41.829 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:41.830 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:41.830 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:41.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:41.871 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:41.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:41.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:41.945 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:42.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:42.028 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:42.028 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:42.086 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:42.086 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:42.086 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:42.087 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:42.831 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:42.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:42.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:42.942 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:43.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:43.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:43.018 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:43.076 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:43.076 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:43.076 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:43.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:43.088 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:43.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:43.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:43.195 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:43.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:43.283 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:43.283 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:43.340 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:43.340 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:43.340 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:43.341 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:44.077 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:44.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:44.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:44.188 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:44.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:44.262 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:44.262 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:44.319 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:44.320 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:44.320 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:44.320 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:44.342 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:44.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:44.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:44.451 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:44.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:44.536 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:44.536 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:44.593 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:44.593 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:44.593 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:44.593 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:45.322 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:45.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:45.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:45.433 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:45.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:45.509 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:45.510 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:45.566 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:45.567 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:45.567 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:45.567 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:45.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:45.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:45.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:45.703 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:45.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:45.782 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:45.782 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:45.840 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:45.840 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:45.841 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:45.841 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:46.568 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:46.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:46.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:46.686 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:46.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:46.763 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:46.763 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:46.820 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:46.820 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:46.820 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:46.820 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:46.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:46.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:46.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:46.948 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:47.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:47.032 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:47.032 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:47.091 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:47.091 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:47.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:47.092 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:47.822 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:47.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:47.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:47.934 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:48.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:48.009 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:48.009 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:48.066 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:48.067 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:48.067 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:48.067 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:48.093 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:48.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:48.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:48.166 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:48.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:48.254 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:48.254 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:48.311 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:48.311 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:48.311 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:48.311 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:49.068 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:49.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:49.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:49.179 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:49.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:49.252 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:49.252 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:49.308 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:49.308 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:49.309 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:49.309 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:49.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:49.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:49.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:49.393 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:49.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:49.469 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:49.469 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:49.527 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:49.528 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:49.528 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:49.528 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.310 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:50.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:50.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.420 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:50.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:50.494 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.495 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:50.530 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:50.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:50.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:50.625 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.625 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.625 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.625 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:50.637 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:50.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:50.716 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:50.717 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:50.774 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:50.774 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:50.774 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:50.774 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.626 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:51.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:51.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.736 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:51.776 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:51.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:51.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:51.859 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:51.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:51.864 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.864 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:51.922 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:51.922 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:51.922 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:51.922 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:51.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:51.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:51.946 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:52.005 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:52.006 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:52.006 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:52.006 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:52.923 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:52.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:52.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:52.993 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:53.007 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:53.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:53.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:53.073 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:53.079 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:53.079 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:53.079 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:53.136 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:53.136 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:53.136 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:53.136 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:53.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:53.159 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:53.159 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:53.217 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:53.217 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:53.217 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:53.217 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:54.136 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:54.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:54.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:54.231 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:54.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:54.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:54.282 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:54.294 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:54.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:54.340 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:54.340 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:54.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:54.377 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:54.377 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:54.397 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:54.397 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:54.397 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:54.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:54.435 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:54.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:54.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:54.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.398 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:55.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:55.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.496 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:55.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:55.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:55.548 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:55.560 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:55.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:55.606 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.606 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:55.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:55.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:55.641 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:55.662 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.662 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.662 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:55.698 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:55.698 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:55.698 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:55.698 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.664 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:56.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:56.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.761 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:56.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:56.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:56.812 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:56.824 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:56.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:56.870 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.870 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:56.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:56.916 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:56.916 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:56.927 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.927 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.927 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.927 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:56.973 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:56.974 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:56.974 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:56.974 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:57.928 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:57.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:57.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:58.026 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:58.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:58.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:58.091 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:58.103 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:58.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:58.109 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:58.109 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:58.166 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:58.166 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:58.166 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:58.166 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:58.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:58.178 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:58.178 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:58.235 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:58.235 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:58.236 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:58.236 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:59.167 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:54:59.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:59.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:59.237 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:54:59.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:59.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:54:59.289 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:54:59.301 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:54:59.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:54:59.307 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:59.307 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:54:59.364 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:59.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:59.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:59.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:54:59.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:54:59.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:54:59.376 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:54:59.433 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:54:59.434 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:54:59.434 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:54:59.434 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.364 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:00.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:00.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:00.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:00.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:00.515 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:00.527 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:00.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:00.573 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.573 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:00.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:00.603 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:00.603 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:00.629 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.630 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.630 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:00.659 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:00.659 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:00.659 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:00.659 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:01.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:01.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.711 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:01.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:01.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:01.763 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:01.775 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:01.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:01.821 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.821 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:01.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:01.859 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:01.859 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:01.878 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.878 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.878 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.878 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:01.916 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:01.916 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:01.916 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:01.916 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:02.879 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:02.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:02.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:02.978 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:02.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:02.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:03.031 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:03.043 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:03.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:03.090 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:03.091 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:03.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:03.122 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:03.122 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:03.147 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:03.147 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:03.147 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:03.147 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:03.179 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:03.179 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:03.179 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:03.180 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:04.149 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:04.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:04.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:04.248 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:04.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:04.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:04.300 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:04.312 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:04.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:04.358 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.359 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:04.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:04.394 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:04.394 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:04.415 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:04.415 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:04.415 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:04.415 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:04.451 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:04.451 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:04.451 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:04.452 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:05.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:05.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:05.514 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:05.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:05.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:05.565 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:05.577 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:05.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:05.623 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.623 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:05.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:05.653 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:05.653 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:05.681 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.681 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.681 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:05.709 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:05.709 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:05.710 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:05.710 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.682 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:06.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:06.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.781 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:06.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:06.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:06.832 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:06.844 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:06.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:06.889 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.889 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:06.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:06.923 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:06.923 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:06.946 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.947 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.947 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.947 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:06.981 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:06.981 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:06.981 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:06.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:07.947 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:07.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:07.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:08.045 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:08.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:08.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:08.098 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:08.109 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:08.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:08.157 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:08.157 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:08.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:08.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:08.182 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:08.214 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:08.214 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:08.214 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:08.214 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:08.239 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:08.239 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:08.239 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:08.239 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:09.215 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:09.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:09.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:09.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:09.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:09.365 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:09.377 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:09.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:09.426 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.426 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:09.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:09.463 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:09.464 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:09.483 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:09.483 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:09.483 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:09.483 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:09.521 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:09.521 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:09.521 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:09.521 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.484 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:10.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:10.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:10.583 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:10.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:10.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:10.635 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:10.647 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:10.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:10.694 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.694 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:10.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:10.722 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:10.722 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:10.751 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:10.779 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:10.779 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:10.779 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:10.779 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:11.752 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:11.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:11.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.850 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:11.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:11.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:11.903 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:11.914 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:11.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:11.961 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:11.962 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:12.000 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:12.000 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:12.000 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:12.018 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.018 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.018 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:12.058 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:12.058 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:12.058 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:12.058 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:13.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:13.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:13.117 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:13.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:13.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:13.169 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:13.181 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:13.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:13.228 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:13.229 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:13.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:13.264 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:13.265 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:13.286 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:13.286 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:13.286 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:13.286 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:13.321 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:13.322 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:13.322 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:13.322 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:14.287 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:14.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:14.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.385 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:14.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:14.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:14.438 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:14.449 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:14.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:14.498 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.498 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:14.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:14.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:14.538 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:14.555 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.556 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.556 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.556 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:14.596 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:14.596 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:14.596 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:14.596 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.556 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:15.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:15.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:15.655 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:15.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:15.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:15.720 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:15.732 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:15.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:15.737 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:15.737 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:15.794 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.794 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.794 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.794 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:15.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:15.809 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:15.809 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:15.865 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:15.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:15.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:15.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:16.795 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:16.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:16.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.893 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:16.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:16.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:16.945 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:16.957 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:17.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:17.004 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.004 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:17.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:17.032 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:17.032 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:17.061 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:17.061 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:17.061 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:17.061 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:17.090 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:17.090 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:17.091 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:17.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.062 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:18.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:18.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:18.165 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:18.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:18.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:18.217 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:18.229 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:18.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:18.275 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:18.276 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:18.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:18.315 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:18.315 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:18.333 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.333 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.333 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.333 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:18.372 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:18.373 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:18.373 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:18.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.334 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:19.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:19.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:19.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:19.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:19.444 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:19.456 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:19.504 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:19.504 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.504 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:19.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:19.532 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:19.532 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:19.560 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.561 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.561 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.561 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:19.588 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:19.588 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:19.588 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:19.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.561 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:20.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:20.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:20.661 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:20.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:20.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:20.713 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:20.725 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:20.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:20.771 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:20.772 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:20.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:20.807 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:20.808 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:20.829 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.829 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.829 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.830 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:20.864 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:20.865 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:20.865 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:20.865 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:21.830 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:21.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:21.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.929 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:21.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:21.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:21.979 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:21.991 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:22.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:22.038 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:22.039 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:22.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:22.076 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:22.076 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:22.095 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:22.095 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:22.095 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:22.095 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:22.134 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:22.134 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:22.134 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:22.134 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.096 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:23.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:23.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:23.194 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:23.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:23.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:23.246 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:23.258 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:23.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:23.306 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.306 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:23.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:23.345 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:23.345 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:23.363 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.364 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.364 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:23.403 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:23.404 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:23.404 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:23.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.365 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:24.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:24.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:24.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:24.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:24.523 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:24.535 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:24.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:24.540 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.541 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:24.598 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.599 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.599 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.599 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:24.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:24.616 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:24.616 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:24.673 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:24.673 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:24.674 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:24.674 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.600 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:25.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:25.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:25.699 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:25.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:25.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:25.751 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:25.763 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:25.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:25.811 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:25.811 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:25.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:25.847 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:25.847 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:25.868 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.868 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.868 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:25.904 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:25.905 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:25.905 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:25.905 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:26.869 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:26.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:26.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.934 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:26.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:26.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:26.985 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:26.997 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:27.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:27.043 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:27.043 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:27.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:27.073 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:27.073 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:27.101 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:27.101 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:27.101 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:27.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:27.130 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:27.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:27.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:27.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.103 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:28.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:28.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:28.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:28.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:28.256 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:28.268 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:28.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:28.315 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.316 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:28.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:28.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:28.346 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:28.371 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.372 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.372 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.373 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:28.403 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:28.403 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:28.403 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:28.403 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.374 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:29.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:29.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.472 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:29.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:29.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:29.524 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:29.536 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:29.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:29.584 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.584 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:29.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:29.624 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:29.625 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:29.642 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.642 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.642 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.643 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:29.682 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:29.683 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:29.683 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:29.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.644 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:30.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:30.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.744 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:30.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:30.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:30.798 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:30.810 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:30.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:30.815 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:30.815 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:30.872 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:30.872 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:30.872 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:30.872 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:30.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:30.879 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:30.879 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:30.936 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:30.936 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:30.936 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:30.936 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:31.872 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:31.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:31.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:31.971 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:31.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:31.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:32.021 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:32.033 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:32.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:32.081 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:32.081 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:32.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:32.107 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:32.107 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:32.138 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:32.138 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:32.138 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:32.138 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:32.164 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:32.164 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:32.164 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:32.164 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.139 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:33.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:33.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.238 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:33.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:33.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:33.290 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:33.302 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:33.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:33.348 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.348 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:33.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:33.383 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:33.383 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:33.404 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.405 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.405 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.405 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:33.440 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:33.440 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:33.440 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:33.440 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.406 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:34.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:34.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.504 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:34.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:34.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:34.556 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:34.568 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:34.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:34.616 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.616 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:34.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:34.651 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:34.651 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:34.672 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.672 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.673 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.673 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:34.707 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:34.708 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:34.708 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:34.708 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.674 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:35.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:35.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.773 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:35.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:35.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:35.825 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:35.837 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:35.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:35.883 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:35.883 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:35.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:35.913 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:35.913 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:35.939 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:35.940 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:35.940 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:35.940 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:35.971 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:35.971 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:35.971 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:35.971 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:36.941 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:36.942 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:36.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:37.039 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:37.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:37.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:37.093 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:37.105 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:37.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:37.153 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.154 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:37.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:37.189 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:37.189 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:37.211 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.211 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.211 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.212 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:37.247 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:37.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:37.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:37.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.213 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:38.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:38.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.313 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:38.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:38.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:38.365 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:38.377 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:38.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:38.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.423 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:38.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:38.462 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:38.462 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:38.480 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.480 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.480 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.480 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:38.520 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:38.520 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:38.520 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:38.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.482 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:39.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:39.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.581 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:39.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:39.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:39.634 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:39.646 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:39.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:39.693 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.693 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:39.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:39.732 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:39.732 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:39.751 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.751 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.751 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:39.789 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:39.789 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:39.789 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:39.789 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.752 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:40.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:40.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.851 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:40.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:40.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:40.905 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:40.917 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:40.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:40.922 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:40.923 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:40.979 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:40.980 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:40.980 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:40.980 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:40.999 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:40.999 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:40.999 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:41.057 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:41.057 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:41.057 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:41.057 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:41.981 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:41.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:41.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:42.079 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:42.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:42.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:42.131 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:42.143 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:42.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:42.190 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.190 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:42.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:42.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:42.229 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:42.247 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.247 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.247 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.247 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:42.287 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:42.287 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:42.288 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:42.288 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.248 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:43.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:43.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.348 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:43.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:43.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:43.399 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:43.411 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:43.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:43.459 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.459 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:43.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:43.486 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:43.486 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:43.516 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.516 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.516 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.516 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:43.543 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:43.543 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:43.543 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:43.543 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.517 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:44.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:44.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.615 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:44.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:44.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:44.666 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:44.679 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:44.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:44.724 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.725 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:44.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:44.753 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:44.753 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:44.782 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.783 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.783 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.783 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:44.810 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:44.810 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:44.810 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:44.810 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:45.785 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:45.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:45.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.883 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:45.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:45.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:45.934 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:45.946 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:45.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:45.994 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:45.994 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:46.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:46.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:46.018 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:46.051 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:46.051 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:46.051 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:46.051 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:46.075 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:46.075 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:46.075 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:46.075 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.052 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:47.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:47.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.150 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:47.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:47.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:47.202 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:47.214 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:47.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:47.261 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.261 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:47.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:47.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:47.285 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:47.317 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.317 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.317 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.317 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:47.342 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:47.342 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:47.342 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:47.342 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.318 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:48.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:48.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.416 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:48.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:48.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:48.469 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:48.480 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:48.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:48.529 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.529 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:48.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:48.562 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:48.563 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:48.586 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.586 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.586 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.587 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:48.621 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:48.621 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:48.621 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:48.621 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.588 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:49.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:49.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.687 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:49.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:49.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:49.739 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:49.750 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:49.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:49.797 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.797 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:49.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:49.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:49.836 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:49.854 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.854 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.854 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.854 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:49.895 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:49.895 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:49.895 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:49.895 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:50.855 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:50.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:50.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:50.953 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:50.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:50.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:51.006 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:51.018 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:51.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:51.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:51.065 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:51.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:51.100 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:51.100 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:51.122 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:51.123 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:51.123 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:51.123 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:51.157 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:51.157 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:51.157 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:51.157 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.124 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:52.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:52.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.223 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:52.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:52.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:52.275 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:52.287 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:52.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:52.333 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.333 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:52.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:52.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:52.363 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:52.392 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.392 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.392 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.392 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:52.420 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:52.420 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:52.420 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:52.420 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.394 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:53.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:53.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.492 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:53.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:53.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:53.554 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:53.566 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:53.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:53.572 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.573 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:53.629 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.629 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.629 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.630 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:53.648 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:53.648 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:53.648 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:53.706 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:53.706 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:53.706 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:53.706 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.631 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:54.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:54.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.735 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:54.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:54.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:54.788 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:54.800 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:54.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:54.846 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.846 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:54.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:54.874 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:54.874 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:54.903 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.903 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.903 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.903 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:54.932 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:54.932 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:54.932 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:54.932 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:55.905 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:55.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:55.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:56.002 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:56.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:56.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:56.055 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:56.067 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:56.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:56.073 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:56.073 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:56.130 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.130 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.130 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.130 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:56.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:56.148 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:56.148 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:56.206 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:56.207 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:56.207 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:56.207 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.131 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:57.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:57.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:57.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:57.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:57.284 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:57.296 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:57.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:57.342 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.342 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:57.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:57.376 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:57.376 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:57.399 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.399 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.399 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.399 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:57.434 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:57.435 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:57.435 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:57.435 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.401 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T22:55:58.401 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:58.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.498 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T22:55:58.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:58.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T22:55:58.550 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T22:55:58.562 DEBUG:teuthology.orchestra.run.trial112:> true 2026-02-12T22:55:58.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T22:55:58.610 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.610 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T22:55:58.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial112.front.sepia.ceph.com' 2026-02-12T22:55:58.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-12T22:55:58.640 DEBUG:teuthology.orchestra.run.trial112:> uname -r 2026-02-12T22:55:58.668 INFO:teuthology.orchestra.run.trial154.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.668 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.668 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.668 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.669 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1365, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 1472, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.671 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T22:55:58.682 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T22:55:58.716 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{rpm_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} failure_reason: failed to install new kernel version within timeout owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T22:55:58.716 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T22:55:58.790 INFO:teuthology.orchestra.run.trial112.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-12T22:55:58.790 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.27.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-12T22:55:58.790 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-12T22:55:58.790 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3e9168473cad21309cea53f654286d78057913dd/teuthology/task/kernel.py", line 701, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: failed to install new kernel version within timeout 2026-02-12T22:55:58.836 INFO:teuthology.run:FAIL