2024-04-18T22:54:51.255 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T22:54:51.255 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662686 --owner scheduled_teuthology@teuthology --verbose --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} -- /home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662686/orig.config.yaml 2024-04-18T22:54:51.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T22:54:51.386 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662686 branch: squid description: rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662686' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: global: auth client required: none auth cluster required: none auth service required: none auth supported: none debug asok: 0/0 debug auth: 0/0 debug bdev: 0/0 debug bluefs: 0/0 debug bluestore: 0/0 debug buffer: 0/0 debug civetweb: 0/0 debug client: 0/0 debug compressor: 0/0 debug context: 0/0 debug crush: 0/0 debug crypto: 0/0 debug dpdk: 0/0 debug eventtrace: 0/0 debug filer: 0/0 debug filestore: 0/0 debug finisher: 0/0 debug fuse: 0/0 debug heartbeatmap: 0/0 debug javaclient: 0/0 debug journal: 0/0 debug journaler: 0/0 debug kstore: 0/0 debug lockdep: 0/0 debug mds: 0/0 debug mds balancer: 0/0 debug mds locker: 0/0 debug mds log: 0/0 debug mds log expire: 0/0 debug mds migrator: 0/0 debug memdb: 0/0 debug mgr: 0/0 debug mgrc: 0/0 debug mon: 0/0 debug monc: 0/0 debug ms: 0/0 debug objclass: 0/0 debug objectcacher: 0/0 debug objecter: 0/0 debug optracker: 0/0 debug osd: 0/0 debug paxos: 0/0 debug perfcounter: 0/0 debug rados: 0/0 debug rbd: 0/0 debug rbd mirror: 0/0 debug rbd replay: 0/0 debug refs: 0/0 debug rgw: 0/0 debug rgw lifecycle: 0/0 debug rgw sync: 0/0 debug rocksdb: 0/0 debug striper: 0/0 debug throttle: 0/0 debug timer: 0/0 debug tp: 0/0 mon election default strategy: 3 osd client message cap: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 0/0 debug ms: 0/0 debug paxos: 0/0 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 0/0 debug journal: 0/0 debug ms: 0/0 debug osd: 0/0 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: wpq flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 1a6a3e742fd81c6d70be70552499bff767652c32 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1a6a3e742fd81c6d70be70552499bff767652c32 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d0bf63dd179c05751e4be49477389aa290c73089 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6512 sha1: 1a6a3e742fd81c6d70be70552499bff767652c32 sleep_before_teardown: 0 subset: 28391/100000 suite: rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d0bf63dd179c05751e4be49477389aa290c73089/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d0bf63dd179c05751e4be49477389aa290c73089 targets: smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOesZU9oz/nAPQm+vRqH4b4vyBDli0WsgbNZvs3ZHEK15HZHtyeU8P+2esBjN1AAkrd0BhuzvauPkIl29b+Qgo0= tasks: - install: null - ceph: fs: xfs log-ignorelist: - \(PG_ - \(OSD_ - \(OBJECT_ - overall HEALTH - \(POOL_APP_NOT_ENABLED\) wait-for-scrub: false - ssh_keys: null - cbt: benchmarks: librbdfio: iodepth: - 32 log_avg_msec: 100 mode: - randrw norandommap: true op_size: - 4194304 osd_ra: - 4096 pool_profile: rbd procs_per_volume: - 1 time: 60 vol_size: 4096 volumes_per_client: - 2 cluster: iterations: 1 osds_per_node: 3 pool_profiles: rbd: pg_size: 128 pgp_size: 128 replication: 3 user: ubuntu monitoring_profiles: perf: args: stat -p {pid} -o {perf_dir}/perf_stat.{pid} nodes: - osds perf_cmd: perf pid_glob: ceph-osd.*.pid teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_21:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T22:54:51.386 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d0bf63dd179c05751e4be49477389aa290c73089/qa; will attempt to use it 2024-04-18T22:54:51.387 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d0bf63dd179c05751e4be49477389aa290c73089/qa/tasks 2024-04-18T22:54:51.387 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T22:54:51.389 INFO:teuthology.task.internal:Checking packages... 2024-04-18T22:54:51.415 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1a6a3e742fd81c6d70be70552499bff767652c32' 2024-04-18T22:54:51.415 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T22:54:51.415 INFO:teuthology.packaging:ref: None 2024-04-18T22:54:51.415 INFO:teuthology.packaging:tag: None 2024-04-18T22:54:51.415 INFO:teuthology.packaging:branch: squid 2024-04-18T22:54:51.416 INFO:teuthology.packaging:sha1: 1a6a3e742fd81c6d70be70552499bff767652c32 2024-04-18T22:54:51.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-18T22:54:51.706 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2401-gd0bf63dd-1jammy 2024-04-18T22:54:51.707 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T22:54:51.713 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T22:54:51.714 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T22:54:51.759 INFO:teuthology.task.internal:Saving configuration 2024-04-18T22:54:51.776 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T22:54:51.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T22:54:51.809 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 22:48:10.165992', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFyhpYK4TVAGzvLzKjuKlM00GkYIoPi4UIELbiHQl0+R'} 2024-04-18T22:54:51.809 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T22:54:51.817 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-04-18T22:54:51.817 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T22:54:51.867 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3279acd280>, signals=[15]) 2024-04-18T22:54:51.867 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T22:54:51.874 INFO:teuthology.task.internal:Opening connections... 2024-04-18T22:54:51.874 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-04-18T22:54:51.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:54:51.960 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T22:54:51.965 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-04-18T22:54:52.070 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-04-18T22:54:52.071 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="22.04" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=jammy 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-18T22:54:52.122 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=jammy 2024-04-18T22:54:52.123 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-18T22:54:52.146 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T22:54:52.154 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T22:54:52.185 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T22:54:52.185 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-04-18T22:54:52.190 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T22:54:52.202 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T22:54:52.202 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-04-18T22:54:52.240 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T22:54:52.274 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T22:54:52.288 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T22:54:52.288 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T22:54:52.289 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T22:54:52.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T22:54:52.294 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:54:52.342 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-56-generic 2024-04-18T22:54:52.343 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.15.0-56-generic 2024-04-18T22:54:52.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2024-04-18T22:54:52.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-04-18T22:54:52.645 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T22:54:52.682 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T22:54:52.713 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-18T22:54:52.879 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-18T22:54:52.986 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-18T22:54:53.176 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-18T22:54:53.177 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,351 kB] 2024-04-18T22:54:53.184 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-18T22:54:53.191 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-18T22:54:53.192 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-18T22:54:53.193 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,754 kB] 2024-04-18T22:54:53.228 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [295 kB] 2024-04-18T22:54:53.232 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T22:54:53.233 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-04-18T22:54:53.250 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-18T22:54:53.258 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-18T22:54:53.263 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-18T22:54:53.264 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-18T22:54:53.290 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-18T22:54:53.291 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-18T22:54:53.291 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-18T22:54:53.291 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-18T22:54:53.292 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-18T22:54:53.292 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-18T22:54:53.292 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-18T22:54:53.293 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-18T22:54:53.313 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-18T22:54:53.314 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-18T22:54:53.338 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-18T22:54:54.672 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-18T22:54:55.149 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [238 kB] 2024-04-18T22:54:55.412 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-18T22:54:55.424 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-18T22:54:55.444 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-18T22:54:57.947 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-18T22:54:58.538 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-18T22:54:58.538 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-18T22:54:59.300 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-18T22:55:00.547 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-18T22:55:00.963 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-18T22:55:00.969 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-18T22:55:00.970 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-18T22:55:00.984 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-18T22:55:00.988 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-18T22:55:05.273 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 12.9 MB in 8s (1,528 kB/s) 2024-04-18T22:55:06.594 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-04-18T22:55:06.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T22:55:06.670 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-04-18T22:55:06.875 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-04-18T22:55:06.875 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-04-18T22:55:07.049 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T22:55:07.050 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T22:55:07.050 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T22:55:07.050 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T22:55:07.051 INFO:teuthology.orchestra.run.smithi115.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-18T22:55:07.051 INFO:teuthology.orchestra.run.smithi115.stdout: python2.7-minimal 2024-04-18T22:55:07.051 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T22:55:07.051 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-04-18T22:55:07.052 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T22:55:07.052 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-18T22:55:07.052 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-18T22:55:07.053 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-04-18T22:55:07.053 INFO:teuthology.orchestra.run.smithi115.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T22:55:07.053 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-04-18T22:55:07.053 INFO:teuthology.orchestra.run.smithi115.stdout: thermald 2024-04-18T22:55:07.107 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-04-18T22:55:07.107 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-18T22:55:07.107 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-18T22:55:07.107 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-18T22:55:07.108 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2024-04-18T22:55:07.109 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T22:55:07.166 INFO:teuthology.orchestra.run.smithi115.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T22:55:07.166 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 113 MB of archives. 2024-04-18T22:55:07.166 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T22:55:07.166 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-18T22:55:07.735 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-18T22:55:07.858 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-18T22:55:08.776 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-18T22:55:08.777 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-18T22:55:08.777 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-18T22:55:08.898 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-18T22:55:08.923 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-18T22:55:09.319 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 113 MB in 2s (62.7 MB/s) 2024-04-18T22:55:09.502 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-18T22:55:11.516 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-18T22:55:11.520 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T22:55:11.599 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:13.693 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-18T22:55:13.714 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T22:55:13.799 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:14.262 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-18T22:55:14.282 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T22:55:14.320 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:20.998 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T22:55:21.130 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T22:55:21.413 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T22:55:21.526 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T22:55:21.837 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-18T22:55:21.860 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-18T22:55:21.903 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T22:55:27.223 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-18T22:55:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-18T22:55:27.298 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:30.601 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-18T22:55:30.733 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-18T22:55:31.074 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-18T22:55:31.170 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:31.297 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-18T22:55:31.425 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:32.759 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-18T22:55:32.759 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-18T22:55:32.759 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T22:55:32.760 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T22:55:32.910 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:34.361 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:35.713 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-18T22:55:35.838 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-18T22:55:35.965 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-18T22:55:36.023 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T22:55:36.023 INFO:teuthology.orchestra.run.smithi115.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-18T22:55:50.174 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T22:55:50.175 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub' 2024-04-18T22:55:50.193 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T22:55:50.216 INFO:teuthology.orchestra.run.smithi115.stdout:Generating grub configuration file ... 2024-04-18T22:55:50.468 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T22:55:50.488 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T22:55:50.757 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T22:55:50.763 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T22:55:50.835 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T22:55:50.840 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T22:55:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T22:55:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T22:55:50.985 INFO:teuthology.orchestra.run.smithi115.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T22:55:51.019 INFO:teuthology.orchestra.run.smithi115.stdout:done 2024-04-18T22:55:51.483 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 21 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T22:55:51.509 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.15.0.102.99 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2024-04-18T22:55:51.510 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2024-04-18T22:55:51.510 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-18T22:55:51.510 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T22:55:51.511 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T22:55:51.511 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T22:55:51.511 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T22:55:51.511 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2024-04-18T22:55:51.680 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-04-18T22:55:51.843 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-18T22:55:51.843 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-18T22:55:51.885 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-18T22:55:52.091 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-18T22:55:52.148 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [612 kB] 2024-04-18T22:55:52.282 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,572 kB] 2024-04-18T22:55:52.335 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [300 kB] 2024-04-18T22:55:52.341 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,765 kB] 2024-04-18T22:55:52.368 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [298 kB] 2024-04-18T22:55:52.372 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-18T22:55:52.383 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-18T22:55:53.064 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 5,979 kB in 1s (5,006 kB/s) 2024-04-18T22:55:54.023 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-04-18T22:55:54.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-18T22:55:54.100 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-04-18T22:55:54.312 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-04-18T22:55:54.313 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-04-18T22:55:54.482 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-04-18T22:55:54.482 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-18T22:55:54.482 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-18T22:55:54.482 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-18T22:55:54.482 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-18T22:55:54.483 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-18T22:55:54.483 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-18T22:55:54.483 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-04-18T22:55:54.484 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-18T22:55:54.484 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-18T22:55:54.484 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-18T22:55:54.485 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-04-18T22:55:54.485 INFO:teuthology.orchestra.run.smithi115.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-18T22:55:54.485 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-04-18T22:55:54.485 INFO:teuthology.orchestra.run.smithi115.stdout: thermald 2024-04-18T22:55:54.514 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-04-18T22:55:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-18T22:55:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-18T22:55:54.514 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-18T22:55:54.515 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2024-04-18T22:55:54.515 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-18T22:55:54.695 INFO:teuthology.orchestra.run.smithi115.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-18T22:55:54.695 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 113 MB of archives. 2024-04-18T22:55:54.695 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-18T22:55:54.695 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-18T22:55:56.105 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-18T22:55:56.461 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-18T22:55:58.715 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-18T22:55:58.716 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-18T22:55:58.716 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-18T22:55:59.157 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-18T22:55:59.242 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-18T22:55:59.600 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 113 MB in 5s (24.0 MB/s) 2024-04-18T22:55:59.748 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-18T22:55:59.821 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165033 files and directories currently installed.) 2024-04-18T22:55:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-18T22:55:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:02.257 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-18T22:56:02.284 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-18T22:56:02.339 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:02.844 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-18T22:56:02.870 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-18T22:56:02.910 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:09.344 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-18T22:56:09.472 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.102.99) ... 2024-04-18T22:56:09.827 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-18T22:56:09.950 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.102.99) ... 2024-04-18T22:56:10.279 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-18T22:56:10.306 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-18T22:56:10.345 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-18T22:56:16.278 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-18T22:56:16.320 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-18T22:56:16.360 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:19.070 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-18T22:56:19.198 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.102.99) ... 2024-04-18T22:56:19.542 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-18T22:56:19.669 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:19.795 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-18T22:56:19.948 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:21.234 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-18T22:56:21.249 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-18T22:56:21.249 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-18T22:56:21.249 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-18T22:56:21.392 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:22.778 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:24.137 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-18T22:56:24.271 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-18T22:56:24.397 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-18T22:56:24.446 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-18T22:56:24.446 INFO:teuthology.orchestra.run.smithi115.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-18T22:56:36.337 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-18T22:56:36.337 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub' 2024-04-18T22:56:36.337 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T22:56:36.347 INFO:teuthology.orchestra.run.smithi115.stdout:Generating grub configuration file ... 2024-04-18T22:56:36.549 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-18T22:56:36.557 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-18T22:56:36.820 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T22:56:36.825 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T22:56:36.869 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T22:56:36.874 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T22:56:36.915 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T22:56:36.920 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T22:56:37.066 INFO:teuthology.orchestra.run.smithi115.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T22:56:37.066 INFO:teuthology.orchestra.run.smithi115.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T22:56:37.066 INFO:teuthology.orchestra.run.smithi115.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T22:56:37.095 INFO:teuthology.orchestra.run.smithi115.stdout:done 2024-04-18T22:56:37.607 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2024-04-18T22:56:37.623 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 21 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.15.0.105.102 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2024-04-18T22:56:37.624 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2024-04-18T22:56:37.625 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-04-18T22:56:37.673 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.MsEj7RYsX9 2024-04-18T22:56:37.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MsEj7RYsX9 2024-04-18T22:56:37.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.MsEj7RYsX9 2024-04-18T22:56:37.861 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.MsEj7RYsX9 is 12KB 2024-04-18T22:56:37.874 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.MsEj7RYsX9 2024-04-18T22:56:37.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-18T22:56:37.934 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-18T22:56:37.934 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-18T22:56:37.934 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-18T22:56:38.015 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-18T22:56:38.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo update-grub 2024-04-18T22:56:38.879 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2024-04-18T22:56:38.880 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-18T22:56:38.889 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-04-18T22:56:39.088 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-18T22:56:39.094 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-18T22:56:39.346 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-18T22:56:39.351 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-18T22:56:39.396 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-18T22:56:39.401 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-18T22:56:39.441 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-18T22:56:39.447 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-18T22:56:39.580 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-18T22:56:39.580 INFO:teuthology.orchestra.run.smithi115.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-18T22:56:39.580 INFO:teuthology.orchestra.run.smithi115.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-18T22:56:39.613 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-04-18T22:56:39.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-04-18T22:57:09.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:57:09.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:57:09.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:57:44.227 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-18T22:57:53.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:57:53.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:11.619 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-18T22:58:23.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:23.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:25.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-18T22:58:40.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:40.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:41.037 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:41.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:41.642 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:41.642 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:41.691 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:41.692 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:41.692 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:41.692 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:42.693 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:42.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:42.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:42.788 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:42.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:42.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:42.866 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:42.914 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:42.914 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:42.914 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:42.914 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:43.915 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:43.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:43.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:43.994 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:44.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:44.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:44.066 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:44.114 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:44.114 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:44.114 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:44.114 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:45.115 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:45.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:45.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:45.246 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:45.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:45.327 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:45.327 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:45.374 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:45.375 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:45.375 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:45.375 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:46.376 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:46.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:46.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:46.470 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:46.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:46.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:46.550 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:46.598 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:46.598 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:46.598 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:46.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:47.599 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:47.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:47.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:47.679 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:47.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:47.758 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:47.759 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:47.806 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:47.806 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:47.806 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:47.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:48.807 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:48.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:48.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:48.897 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:48.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:48.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:48.970 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:49.017 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:49.018 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:49.018 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:49.018 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:50.019 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:50.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:50.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:50.102 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:50.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:50.178 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:50.178 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:50.226 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:50.227 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:50.227 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:50.227 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:51.227 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:51.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:51.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:51.314 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:51.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:51.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:51.390 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:51.438 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:51.438 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:51.438 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:51.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:52.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:52.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:52.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:52.521 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:52.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:52.598 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:52.598 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:52.646 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:52.646 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:52.646 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:52.646 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:53.647 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:53.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:53.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:53.730 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:53.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:53.806 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:53.806 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:53.854 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:53.854 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:53.854 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:53.855 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:54.856 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:54.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:54.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:54.935 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:55.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:55.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:55.011 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:55.059 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:55.059 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:55.059 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:55.059 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:56.060 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:56.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:56.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:56.145 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:56.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:56.227 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:56.227 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:56.274 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:56.274 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:56.274 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:56.274 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:57.275 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:57.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:57.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:57.354 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:57.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:57.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:57.431 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:57.478 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:57.478 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:57.478 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:57.478 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:58.479 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:58.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:58.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:58.559 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:58.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:58.635 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:58.635 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:58.681 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:58.682 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:58.682 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:58.682 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:58:59.684 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:58:59.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:59.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:58:59.767 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:58:59.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:58:59.838 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:58:59.838 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:58:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:58:59.886 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:58:59.886 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:58:59.886 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:00.887 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:00.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:00.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:00.972 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:01.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:01.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:01.054 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:01.106 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:01.106 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:01.106 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:01.107 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:02.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:02.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:02.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:02.193 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:02.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:02.278 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:02.278 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:02.326 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:02.326 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:02.326 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:02.327 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:03.327 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:03.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:03.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:03.424 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:03.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:03.503 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:03.503 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:03.550 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:03.551 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:03.551 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:03.551 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:04.552 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:04.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:04.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:04.634 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:04.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:04.715 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:04.715 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:04.762 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:04.762 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:04.762 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:04.762 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:05.763 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:05.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:05.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:05.852 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:05.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:05.931 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:05.931 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:05.978 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:05.978 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:05.978 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:05.978 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:06.979 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:06.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:06.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:07.058 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:07.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:07.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:07.134 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:07.181 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:07.182 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:07.182 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:07.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:08.183 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:08.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:08.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:08.273 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:08.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:08.350 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:08.350 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:08.397 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:08.397 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:08.398 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:08.398 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:09.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:09.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:09.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:09.490 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:09.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:09.566 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:09.567 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:09.614 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:09.614 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:09.614 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:09.615 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:10.615 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:10.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:10.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:10.698 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:10.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:10.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:10.778 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:10.826 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:10.826 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:10.826 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:10.826 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:11.827 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:11.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:11.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:11.914 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:11.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:11.994 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:11.994 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:12.041 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:12.041 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:12.042 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:12.042 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:13.042 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:13.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:13.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:13.129 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:13.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:13.207 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:13.207 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:13.253 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:13.254 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:13.254 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:13.254 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:14.255 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:14.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:14.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:14.342 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:14.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:14.414 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:14.414 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:14.461 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:14.461 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:14.462 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:14.462 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:15.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:15.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:15.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:15.597 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:15.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:15.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:15.674 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:15.721 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:15.721 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:15.722 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:15.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:16.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:16.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:16.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:16.813 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:16.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:16.891 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:16.891 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:16.938 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:16.938 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:16.938 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:16.938 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:17.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:17.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:17.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:18.026 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:18.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:18.109 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:18.109 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:18.154 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:18.154 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:18.154 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:18.154 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:19.164 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:19.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:19.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:19.309 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:19.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:19.386 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:19.386 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:19.438 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:19.438 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:19.438 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:19.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:20.439 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:20.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:20.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:20.529 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:20.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:20.606 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:20.607 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:20.654 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:20.654 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:20.654 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:20.654 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:21.655 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:21.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:21.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:21.744 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:21.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:21.823 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:21.823 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:21.870 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:21.871 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:21.871 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:21.871 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:22.872 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:22.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:22.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:22.960 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:23.043 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:23.043 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:23.044 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:23.090 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:23.090 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:23.091 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:23.091 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:24.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:24.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:24.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:24.170 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:24.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:24.250 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:24.251 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:24.297 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:24.297 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:24.297 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:24.298 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:25.298 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:25.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:25.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:25.382 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:25.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:25.458 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:25.459 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:25.506 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:25.506 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:25.506 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:25.506 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:26.508 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:26.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:26.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:26.598 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:26.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:26.674 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:26.675 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:26.722 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:26.722 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:26.722 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:26.722 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:27.723 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:27.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:27.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:27.806 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:27.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:27.887 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:27.887 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:27.934 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:27.934 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:27.934 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:27.934 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:28.935 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:28.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:28.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:29.024 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:29.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:29.102 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:29.102 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:29.150 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:29.150 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:29.150 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:29.150 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:30.151 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:30.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:30.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:30.261 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:30.335 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:30.335 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:30.335 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:30.381 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:30.382 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:30.382 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:30.382 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:31.383 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:31.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:31.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:31.472 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:31.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:31.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:31.546 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:31.593 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:31.594 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:31.594 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:31.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:32.595 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:32.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:32.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:32.681 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:32.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:32.759 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:32.760 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:32.806 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:32.806 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:32.806 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:32.806 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:33.808 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:33.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:33.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:33.894 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:33.975 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:33.975 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:33.975 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:34.021 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:34.021 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:34.021 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:34.021 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:35.022 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:35.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:35.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:35.100 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:35.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:35.181 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:35.181 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:35.225 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:35.225 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:35.225 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:35.225 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:36.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:36.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:36.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:36.332 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:36.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:36.410 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:36.410 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:36.457 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:36.458 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:36.458 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:36.458 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:37.458 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:37.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:37.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:37.558 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:37.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:37.634 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:37.634 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:37.683 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:37.683 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:37.683 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:37.683 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:38.685 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:38.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:38.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:38.764 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:38.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:38.842 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:38.843 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:38.889 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:38.889 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:38.889 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:38.890 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:39.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:39.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:39.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:39.983 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:40.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:40.060 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:40.060 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:40.106 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:40.106 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:40.106 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:40.106 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:41.108 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:41.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:41.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:41.204 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:41.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:41.282 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:41.287 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:41.329 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:41.329 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:41.329 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:41.329 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:42.330 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:42.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:42.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:42.410 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:42.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:42.486 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:42.486 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:42.535 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:42.535 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:42.535 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:42.535 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:43.536 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:43.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:43.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:43.621 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:43.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:43.702 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:43.702 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:43.751 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:43.751 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:43.751 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:43.751 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:44.752 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:44.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:44.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:44.842 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:44.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:44.918 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:44.918 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:44.965 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:44.965 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:44.965 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:44.965 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:45.966 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:45.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:45.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:46.057 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:46.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:46.134 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:46.134 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:46.181 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:46.182 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:46.182 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:46.182 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:47.182 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:47.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:47.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:47.271 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:47.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:47.351 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:47.351 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:47.397 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:47.397 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:47.397 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:47.397 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:48.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:48.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:48.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:48.489 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:48.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:48.570 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:48.570 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:48.618 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:48.618 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:48.619 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:48.619 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:49.619 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:49.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:49.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:49.717 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:49.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:49.791 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:49.791 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:49.837 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:49.837 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:49.837 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:49.838 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:50.838 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:50.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:50.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:50.918 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:50.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:50.998 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:50.998 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:51.045 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:51.046 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:51.046 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:51.046 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:52.047 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:52.048 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:52.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:52.140 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:52.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:52.214 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:52.215 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:52.262 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:52.262 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:52.262 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:52.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:53.264 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:53.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:53.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:53.353 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:53.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:53.430 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:53.430 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:53.477 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:53.477 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:53.477 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:53.477 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:54.478 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:54.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:54.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:54.569 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:54.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:54.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:54.650 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:54.697 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:54.697 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:54.697 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:54.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:55.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:55.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:55.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:55.778 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:55.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:55.858 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:55.858 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:55.906 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:55.906 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:55.906 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:55.906 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:56.908 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:56.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:56.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:57.033 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:57.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:57.111 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:57.111 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:57.157 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:57.158 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:57.158 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:57.158 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:58.159 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:58.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:58.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:58.246 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:58.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:58.323 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:58.323 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:58.369 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:58.369 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:58.369 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:58.369 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T22:59:59.370 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T22:59:59.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:59.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:59:59.466 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T22:59:59.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T22:59:59.546 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T22:59:59.546 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T22:59:59.593 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T22:59:59.593 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T22:59:59.593 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T22:59:59.594 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:00.594 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:00.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:00.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:00.734 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:00.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:00.814 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:00.814 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:00.861 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:00.861 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:00.861 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:00.861 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:01.862 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:01.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:01.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:01.950 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:02.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:02.030 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:02.030 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:02.077 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:02.077 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:02.077 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:02.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:03.078 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:03.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:03.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:03.162 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:03.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:03.239 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:03.239 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:03.285 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:03.285 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:03.285 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:03.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:04.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:04.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:04.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:04.380 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:04.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:04.462 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:04.462 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:04.509 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:04.509 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:04.509 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:04.509 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:05.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:05.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:05.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:05.614 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:05.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:05.694 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:05.694 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:05.741 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:05.741 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:05.741 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:05.741 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:06.743 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:06.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:06.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:06.834 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:06.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:06.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:06.911 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:06.957 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:06.957 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:06.957 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:06.957 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:07.958 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:07.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:07.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:08.069 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:08.150 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:08.150 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:08.150 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:08.202 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:08.202 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:08.203 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:08.203 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:09.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:09.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:09.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:09.294 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:09.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:09.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:09.370 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:09.417 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:09.417 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:09.417 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:09.417 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:10.418 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:10.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:10.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:10.517 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:10.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:10.594 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:10.594 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:10.641 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:10.642 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:10.642 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:10.642 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:11.643 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:11.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:11.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:11.734 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:11.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:11.811 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:11.811 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:11.857 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:11.858 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:11.858 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:11.858 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:12.859 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:12.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:12.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:12.952 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:13.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:13.030 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:13.030 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:13.077 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:13.077 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:13.077 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:13.077 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:14.080 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:14.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:14.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:14.162 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:14.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:14.242 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:14.243 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:14.289 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:14.289 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:14.289 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:14.289 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:15.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:15.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:15.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:15.369 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:15.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:15.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:15.451 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:15.497 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:15.497 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:15.497 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:15.498 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:16.499 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:16.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:16.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:16.595 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:16.670 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:16.670 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:16.671 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:16.717 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:16.717 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:16.718 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:16.718 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:17.722 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:17.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:17.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:17.810 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:17.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:17.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:17.886 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:17.937 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:17.937 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:17.937 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:17.937 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:18.939 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:18.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:18.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:19.026 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:19.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:19.102 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:19.102 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:19.149 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:19.149 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:19.149 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:19.149 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:20.150 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:20.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:20.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:20.232 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:20.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:20.310 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:20.310 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:20.357 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:20.357 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:20.358 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:20.358 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:21.358 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:21.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:21.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:21.441 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:21.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:21.522 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:21.523 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:21.568 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:21.569 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:21.569 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:21.569 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:22.570 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:22.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:22.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:22.648 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:22.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:22.726 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:22.726 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:22.773 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:22.773 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:22.773 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:22.773 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:23.774 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:23.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:23.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:23.854 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:23.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:23.931 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:23.931 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:23.981 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:23.981 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:23.981 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:23.981 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:24.982 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:24.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:24.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:25.061 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:25.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:25.139 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:25.139 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:25.185 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:25.186 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:25.186 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:25.186 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:26.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:26.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:26.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:26.275 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:26.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:26.354 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:26.354 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:26.401 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:26.401 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:26.401 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:26.401 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:27.402 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:27.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:27.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:27.485 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:27.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:27.559 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:27.559 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:27.605 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:27.605 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:27.605 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:27.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:28.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:28.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:28.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:28.684 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:28.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:28.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:28.766 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:28.815 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:28.815 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:28.815 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:28.815 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:29.816 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:29.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:29.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:29.904 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:29.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:29.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:29.983 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:30.034 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:30.034 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:30.034 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:30.034 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:31.035 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:31.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:31.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:31.116 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:31.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:31.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:31.190 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:31.237 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:31.237 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:31.237 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:31.237 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:32.239 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:32.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:32.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:32.326 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:32.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:32.406 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:32.406 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:32.455 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:32.455 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:32.455 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:32.455 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:33.456 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:33.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:33.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:33.541 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:33.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:33.615 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:33.615 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:33.662 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:33.662 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:33.662 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:33.662 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:34.663 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:34.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:34.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:34.931 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:35.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:35.006 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:35.006 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:35.053 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:35.053 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:35.053 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:35.053 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:36.055 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:36.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:36.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:36.141 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:36.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:36.214 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:36.214 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:36.261 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:36.261 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:36.262 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:36.262 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:37.265 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:37.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:37.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:37.345 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:37.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:37.422 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:37.422 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:37.469 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:37.469 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:37.469 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:37.469 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:38.470 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:38.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:38.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:38.554 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:38.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:38.630 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:38.631 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:38.680 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:38.681 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:38.681 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:38.681 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:39.682 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:39.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:39.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:39.775 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:39.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:39.851 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:39.851 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:39.896 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:39.897 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:39.897 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:39.897 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:40.897 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:40.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:40.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:40.992 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:41.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:41.072 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:41.073 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:41.117 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:41.117 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:41.117 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:41.117 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:42.118 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:42.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:42.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:42.203 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:42.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:42.282 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:42.283 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:42.330 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:42.330 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:42.331 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:42.331 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:43.331 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:43.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:43.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:43.413 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:43.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:43.486 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:43.486 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:43.533 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:43.534 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:43.534 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:43.534 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:44.535 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:44.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:44.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:44.627 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:44.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:44.702 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:44.702 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:44.749 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:44.749 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:44.749 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:44.749 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:45.750 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:45.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:45.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:45.834 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:45.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:45.908 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:45.908 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:45.953 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:45.953 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:45.953 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:45.953 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:46.955 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:46.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:46.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:47.041 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:47.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:47.118 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:47.119 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:47.165 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:47.165 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:47.165 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:47.165 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:48.166 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:48.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:48.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:48.254 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:48.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:48.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:48.330 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:48.376 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:48.377 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:48.377 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:48.377 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:49.378 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:49.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:49.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:49.457 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:49.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:49.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:49.538 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:49.585 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:49.585 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:49.585 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:49.585 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:50.586 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:50.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:50.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:50.668 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:50.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:50.746 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:50.746 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:50.792 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:50.792 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:50.793 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:50.793 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:51.794 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:51.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:51.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:51.885 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:51.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:51.970 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:51.971 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:52.017 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:52.017 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:52.017 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:52.017 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:53.019 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:53.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:53.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:53.105 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:53.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:53.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:53.182 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:53.232 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:53.233 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:53.233 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:53.233 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:54.233 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:54.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:54.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:54.317 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:54.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:54.391 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:54.391 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:54.437 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:54.438 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:54.438 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:54.438 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:55.440 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:55.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:55.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:55.520 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:55.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:55.599 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:55.599 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:55.649 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:55.649 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:55.649 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:55.650 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:56.651 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:56.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:56.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:56.732 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:56.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:56.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:56.810 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:56.857 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:56.857 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:56.857 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:56.857 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:57.858 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:57.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:57.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:57.971 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:58.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:58.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:58.051 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:58.097 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:58.097 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:58.097 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:58.097 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:00:59.099 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:00:59.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:59.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:00:59.228 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:00:59.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:00:59.302 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:00:59.302 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:00:59.348 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:00:59.348 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:00:59.348 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:00:59.349 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:00.350 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:00.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:00.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:00.469 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:00.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:00.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:00.550 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:00.597 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:00.597 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:00.598 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:01.599 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:01.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:01.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:01.697 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:01.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:01.779 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:01.779 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:01.825 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:01.825 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:01.825 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:01.825 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:02.826 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:02.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:02.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:02.913 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:02.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:02.990 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:02.991 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:03.039 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:03.039 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:03.039 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:03.039 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:04.040 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:04.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:04.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:04.127 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:04.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:04.203 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:04.203 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:04.248 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:04.249 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:04.249 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:04.249 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:05.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:05.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:05.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:05.362 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:05.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:05.438 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:05.438 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:05.485 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:05.485 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:05.485 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:05.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:06.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:06.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:06.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:06.570 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:06.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:06.651 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:06.651 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:06.697 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:06.697 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:06.697 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:06.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:07.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:07.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:07.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:07.790 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:07.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:07.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:07.866 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:07.912 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:07.913 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:07.913 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:07.913 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:08.914 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:08.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:08.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:09.022 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:09.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:09.093 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:09.093 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:09.144 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:09.145 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:09.145 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:09.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:10.146 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:10.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:10.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:10.240 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:10.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:10.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:10.319 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:10.366 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:10.366 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:10.366 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:10.366 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:11.367 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:11.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:11.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:11.473 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:11.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:11.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:11.550 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:11.596 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:11.596 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:11.597 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:11.597 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:12.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:12.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:12.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:12.688 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:12.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:12.766 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:12.766 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:12.812 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:12.812 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:12.812 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:12.813 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:13.814 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:13.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:13.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:13.900 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:13.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:13.978 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:13.978 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:14.026 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:14.026 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:14.026 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:14.026 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:15.027 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:15.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:15.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:15.113 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:15.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:15.194 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:15.194 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:15.247 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:15.247 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:15.247 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:15.248 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:16.249 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:16.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:16.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:16.348 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:16.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:16.427 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:16.427 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:16.475 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:16.475 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:16.475 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:16.475 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:17.476 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:17.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:17.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:17.561 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:17.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:17.643 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:17.643 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:17.691 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:17.691 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:17.691 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:17.691 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:18.692 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:18.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:18.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:18.785 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:18.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:18.861 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:18.861 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:18.909 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:18.909 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:18.909 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:18.909 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:19.910 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:19.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:19.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:20.018 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:20.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:20.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:20.099 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:20.145 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:20.145 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:20.145 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:20.145 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:21.146 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:21.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:21.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:21.242 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:21.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:21.318 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:21.318 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:21.364 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:21.364 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:21.364 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:21.364 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:22.365 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:22.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:22.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:22.456 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:22.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:22.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:22.538 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:22.588 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:22.588 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:22.588 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:22.589 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:23.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:23.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:23.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:23.678 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:23.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:23.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:23.754 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:23.801 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:23.801 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:23.801 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:23.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:24.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:24.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:24.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:24.887 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:24.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:24.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:24.963 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:25.008 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:25.008 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:25.009 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:25.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:26.009 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:26.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:26.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:26.104 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:26.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:26.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:26.182 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:26.228 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:26.228 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:26.229 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:26.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:27.229 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:27.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:27.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:27.315 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:27.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:27.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:27.390 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:27.436 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:27.436 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:27.437 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:27.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:28.438 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:28.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:28.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:28.521 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:28.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:28.602 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:28.602 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:28.648 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:28.649 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:28.649 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:28.649 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:29.650 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:29.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:29.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:29.741 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:29.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:29.822 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:29.822 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:29.868 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:29.868 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:29.868 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:29.868 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:30.870 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:30.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:30.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:30.949 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:31.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:31.026 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:31.026 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:31.076 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:31.076 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:31.076 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:31.076 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:32.077 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:32.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:32.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:32.157 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:32.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:32.238 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:32.239 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:32.285 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:32.285 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:32.285 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:32.285 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:33.286 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:33.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:33.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:33.373 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:33.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:33.450 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:33.450 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:33.496 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:33.496 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:33.496 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:33.496 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:34.498 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:34.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:34.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:34.578 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:34.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:34.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:34.650 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:34.696 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:34.696 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:34.697 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:34.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:35.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:35.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:35.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:35.783 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:35.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:35.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:35.866 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:35.912 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:35.955 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:35.955 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:35.955 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:36.956 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:36.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:36.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:37.047 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:37.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:37.126 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:37.126 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:37.172 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:37.172 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:37.173 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:37.173 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:38.173 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:38.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:38.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:38.255 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:38.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:38.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:38.330 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:38.376 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:38.376 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:38.376 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:38.376 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:39.378 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:39.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:39.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:39.463 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:39.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:39.538 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:39.538 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:39.588 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:39.588 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:39.588 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:39.588 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:40.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:40.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:40.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:40.675 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:40.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:40.754 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:40.754 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:40.800 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:40.801 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:40.801 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:40.801 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:41.802 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:41.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:41.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:41.880 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:41.954 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:41.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:41.954 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:42.000 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:42.000 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:42.001 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:42.001 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:43.001 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:43.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:43.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:43.102 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:43.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:43.182 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:43.182 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:43.228 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:43.228 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:43.229 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:43.229 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:44.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:44.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:44.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:44.311 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:44.390 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:44.390 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:44.390 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:44.436 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:44.436 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:44.437 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:44.437 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:45.437 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:45.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:45.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:45.519 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:45.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:45.594 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:45.594 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:45.640 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:45.640 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:45.640 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:45.640 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:46.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:46.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:46.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:46.727 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:46.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:46.806 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:46.807 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:46.852 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:46.853 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:46.853 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:46.853 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:47.854 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:47.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:47.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:47.936 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:48.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:48.010 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:48.010 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:48.055 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:48.056 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:48.056 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:48.056 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:49.057 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:49.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:49.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:49.141 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:49.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:49.218 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:49.218 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:49.269 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:49.269 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:49.269 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:49.269 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:50.270 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:50.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:50.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:50.361 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:50.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:50.438 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:50.439 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:50.484 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:50.485 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:50.485 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:50.485 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:51.486 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:51.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:51.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:51.572 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:51.646 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:51.646 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:51.646 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:51.696 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:51.696 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:51.697 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:51.697 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:52.698 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:52.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:52.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:52.778 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:52.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:52.854 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:52.855 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:52.900 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:52.900 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:52.900 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:52.900 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:53.901 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:53.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:53.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:53.981 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:54.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:54.054 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:54.054 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:54.101 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:54.101 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:54.101 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:54.101 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:55.103 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:55.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:55.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:55.187 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:55.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:55.259 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:55.259 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:55.304 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:55.305 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:55.305 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:55.305 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:56.306 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:56.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:56.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:56.390 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:56.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:56.475 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:56.475 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:56.520 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:56.520 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:56.520 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:56.520 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:57.521 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:57.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:57.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:57.647 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:57.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:57.731 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:57.731 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:57.776 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:57.776 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:57.777 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:57.777 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:58.777 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:58.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:58.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:01:58.858 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:01:58.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:58.939 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:01:58.939 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:01:58.984 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:01:58.984 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:01:58.984 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:01:58.984 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:01:59.985 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:01:59.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:01:59.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:00.070 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:00.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:00.146 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:00.146 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:00.192 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:00.192 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:00.192 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:00.193 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:01.193 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:01.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:01.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:01.276 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:01.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:01.358 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:01.358 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:01.403 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:01.404 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:01.404 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:01.404 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:02.405 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:02.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:02.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:02.482 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:02.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:02.559 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:02.559 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:02.605 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:02.605 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:02.605 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:02.605 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:03.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:03.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:03.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:03.685 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:03.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:03.762 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:03.762 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:03.808 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:03.808 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:03.808 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:03.808 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:04.810 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:04.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:04.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:04.888 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:04.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:04.962 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:04.962 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:05.008 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:05.009 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:05.009 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:05.009 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:06.009 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:06.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:06.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:06.094 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:06.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:06.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:06.174 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:06.220 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:06.220 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:06.220 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:06.221 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:07.221 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:07.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:07.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:07.306 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:07.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:07.382 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:07.382 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:07.427 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:07.428 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:07.428 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:07.428 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:08.429 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:08.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:08.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:08.512 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:08.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:08.590 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:08.590 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:08.640 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:08.640 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:08.641 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:08.641 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:09.641 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T23:02:09.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:09.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:02:09.723 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-18T23:02:09.798 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-18T23:02:09.798 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-18T23:02:09.799 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-18T23:02:09.844 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-105-generic 2024-04-18T23:02:09.844 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-102-generic 2024-04-18T23:02:09.844 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-18T23:02:09.844 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:09.845 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 1238, in task p.spawn(process_role, ctx, config, timeout, role, role_config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 1343, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:10.100 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=6ff3fcc2065b41f7a7df2f906f0fec56 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 1238, in task p.spawn(process_role, ctx, config, timeout, role, role_config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 1343, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ AssertionError: failed to install new kernel version within timeout 2024-04-18T23:02:10.102 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T23:02:10.109 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T23:02:10.217 INFO:teuthology.nuke:Checking targets against current locks 2024-04-18T23:02:10.255 DEBUG:teuthology.nuke:shortname: smithi115 2024-04-18T23:02:10.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T23:02:10.281 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 22:48:10.165992', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOesZU9oz/nAPQm+vRqH4b4vyBDli0WsgbNZvs3ZHEK15HZHtyeU8P+2esBjN1AAkrd0BhuzvauPkIl29b+Qgo0='} 2024-04-18T23:02:10.334 INFO:teuthology.orchestra.console.smithi115:Power off 2024-04-18T23:02:10.334 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:02:10.360 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-04-18T23:02:10.360 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:02:10.384 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-18T23:02:14.386 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:02:14.499 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-18T23:02:18.505 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:02:18.615 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-18T23:02:18.716 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-04-18T23:02:18.823 INFO:teuthology.run:Summary data: description: rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} failure_reason: failed to install new kernel version within timeout owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=6ff3fcc2065b41f7a7df2f906f0fec56 status: fail success: false 2024-04-18T23:02:18.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:02:18.905 INFO:teuthology.run:FAIL