2026-02-12T16:39:40.144 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T16:39:40.161 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:39:40.243 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:36:57-rgw-wip-yuri7-testing-2026-02-11-2303-tentacle-distro-default-trial/46360 branch: wip-yuri7-testing-2026-02-11-2303-tentacle description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '46360' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-12_15:36:57-rgw-wip-yuri7-testing-2026-02-11-2303-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri7-testing-2026-02-11-2303-tentacle ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true rgw gc max queue size: 0 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME - reached quota - POOL_FULL - pool\(s\) full sha1: 979a96ddea514e9ce6b8ff3907ef554badd4066d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 979a96ddea514e9ce6b8ff3907ef554badd4066d openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: FROZEN: null LUKEWARM: null s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-tentacle slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2026-02-11-2303-tentacle sha1: 979a96ddea514e9ce6b8ff3907ef554badd4066d owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1497 sha1: 979a96ddea514e9ce6b8ff3907ef554badd4066d sleep_before_teardown: 0 subset: 111/120000 suite: rgw suite_branch: wip-yuri7-testing-2026-02-11-2303-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_979a96ddea514e9ce6b8ff3907ef554badd4066d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 979a96ddea514e9ce6b8ff3907ef554badd4066d targets: trial105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMga5I+RzDSBVZl0xaexd8qNTdqW2CspmhnXBDwKbIyTN6M6WQ4YC143INm/QAsSvUnJQpFxBdx4Vzj8VoUgio4= trial187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF18ajNPTy3OIM4vNnJ8TBooGucYTYFezpElFmVNxUhMG851C1YplksaIq4P6kPbg50Ccka59/5BgrjOlWmTzs0= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-admin-pagination.sh - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - cls/test_cls_sem_set.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_rgw_datalog.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - workunit: clients: client.0: - rgw/run-rados-pool-quota.sh - ragweed: client.0: default-branch: ceph-tentacle rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh - s3tests-java: client.0: force-branch: ceph-tentacle force-repo: https://github.com/ceph/java_s3tests.git teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_15:36:57 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T16:39:40.243 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_979a96ddea514e9ce6b8ff3907ef554badd4066d/qa; will attempt to use it 2026-02-12T16:39:40.244 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_979a96ddea514e9ce6b8ff3907ef554badd4066d/qa/tasks 2026-02-12T16:39:40.244 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T16:39:40.245 INFO:teuthology.task.internal:Checking packages... 2026-02-12T16:39:40.245 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '979a96ddea514e9ce6b8ff3907ef554badd4066d' 2026-02-12T16:39:40.245 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T16:39:40.245 INFO:teuthology.packaging:ref: None 2026-02-12T16:39:40.246 INFO:teuthology.packaging:tag: None 2026-02-12T16:39:40.246 INFO:teuthology.packaging:branch: wip-yuri7-testing-2026-02-11-2303-tentacle 2026-02-12T16:39:40.246 INFO:teuthology.packaging:sha1: 979a96ddea514e9ce6b8ff3907ef554badd4066d 2026-02-12T16:39:40.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri7-testing-2026-02-11-2303-tentacle 2026-02-12T16:39:40.360 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-648.g979a96dd 2026-02-12T16:39:40.361 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T16:39:40.373 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T16:39:40.373 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T16:39:40.387 INFO:teuthology.task.internal:Saving configuration 2026-02-12T16:39:40.411 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T16:39:40.423 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T16:39:40.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial105.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:36:57-rgw-wip-yuri7-testing-2026-02-11-2303-tentacle-distro-default-trial/46360', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 16:36:17.923888', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMga5I+RzDSBVZl0xaexd8qNTdqW2CspmhnXBDwKbIyTN6M6WQ4YC143INm/QAsSvUnJQpFxBdx4Vzj8VoUgio4='} 2026-02-12T16:39:40.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial187.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:36:57-rgw-wip-yuri7-testing-2026-02-11-2303-tentacle-distro-default-trial/46360', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 16:36:17.924544', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF18ajNPTy3OIM4vNnJ8TBooGucYTYFezpElFmVNxUhMG851C1YplksaIq4P6kPbg50Ccka59/5BgrjOlWmTzs0='} 2026-02-12T16:39:40.543 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T16:39:40.555 INFO:teuthology.task.internal:roles: ubuntu@trial105.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2026-02-12T16:39:40.555 INFO:teuthology.task.internal:roles: ubuntu@trial187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-12T16:39:40.555 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T16:39:40.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x78463dfeafc0>, signals=[15]) 2026-02-12T16:39:40.691 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T16:39:40.703 INFO:teuthology.task.internal:Opening connections... 2026-02-12T16:39:40.703 DEBUG:teuthology.task.internal:connecting to ubuntu@trial105.front.sepia.ceph.com 2026-02-12T16:39:40.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:39:40.766 DEBUG:teuthology.task.internal:connecting to ubuntu@trial187.front.sepia.ceph.com 2026-02-12T16:39:40.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:39:40.828 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T16:39:40.839 DEBUG:teuthology.orchestra.run.trial105:> uname -m 2026-02-12T16:39:40.854 INFO:teuthology.orchestra.run.trial105.stdout:x86_64 2026-02-12T16:39:40.854 DEBUG:teuthology.orchestra.run.trial105:> cat /etc/os-release 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:NAME="CentOS Stream" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:VERSION="9" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:ID="centos" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:ID_LIKE="rhel fedora" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:VERSION_ID="9" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:PLATFORM_ID="platform:el9" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:ANSI_COLOR="0;31" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:LOGO="fedora-logo-icon" 2026-02-12T16:39:40.910 INFO:teuthology.orchestra.run.trial105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T16:39:40.911 INFO:teuthology.orchestra.run.trial105.stdout:HOME_URL="https://centos.org/" 2026-02-12T16:39:40.911 INFO:teuthology.orchestra.run.trial105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T16:39:40.911 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T16:39:40.911 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T16:39:40.911 INFO:teuthology.lock.ops:Updating trial105.front.sepia.ceph.com on lock server 2026-02-12T16:39:40.985 DEBUG:teuthology.orchestra.run.trial187:> uname -m 2026-02-12T16:39:41.001 INFO:teuthology.orchestra.run.trial187.stdout:x86_64 2026-02-12T16:39:41.001 DEBUG:teuthology.orchestra.run.trial187:> cat /etc/os-release 2026-02-12T16:39:41.056 INFO:teuthology.orchestra.run.trial187.stdout:NAME="CentOS Stream" 2026-02-12T16:39:41.056 INFO:teuthology.orchestra.run.trial187.stdout:VERSION="9" 2026-02-12T16:39:41.056 INFO:teuthology.orchestra.run.trial187.stdout:ID="centos" 2026-02-12T16:39:41.056 INFO:teuthology.orchestra.run.trial187.stdout:ID_LIKE="rhel fedora" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:VERSION_ID="9" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:PLATFORM_ID="platform:el9" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:ANSI_COLOR="0;31" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:LOGO="fedora-logo-icon" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:HOME_URL="https://centos.org/" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T16:39:41.057 INFO:teuthology.orchestra.run.trial187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T16:39:41.057 INFO:teuthology.lock.ops:Updating trial187.front.sepia.ceph.com on lock server 2026-02-12T16:39:41.139 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T16:39:41.152 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T16:39:41.164 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T16:39:41.164 DEBUG:teuthology.orchestra.run.trial105:> test '!' -e /home/ubuntu/cephtest 2026-02-12T16:39:41.166 DEBUG:teuthology.orchestra.run.trial187:> test '!' -e /home/ubuntu/cephtest 2026-02-12T16:39:41.181 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T16:39:41.193 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T16:39:41.193 DEBUG:teuthology.orchestra.run.trial105:> test -z $(ls -A /var/lib/ceph) 2026-02-12T16:39:41.221 DEBUG:teuthology.orchestra.run.trial187:> test -z $(ls -A /var/lib/ceph) 2026-02-12T16:39:41.238 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T16:39:41.398 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T16:39:41.417 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-12T16:39:41.417 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-12T16:39:41.417 DEBUG:teuthology.orchestra.run.trial105:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T16:39:41.418 DEBUG:teuthology.orchestra.run.trial187:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T16:39:41.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T16:39:41.433 DEBUG:teuthology.orchestra.run.trial187:> uname -r 2026-02-12T16:39:41.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T16:39:41.433 DEBUG:teuthology.orchestra.run.trial105:> uname -r 2026-02-12T16:39:41.488 INFO:teuthology.orchestra.run.trial187.stdout:5.14.0-645.el9.x86_64 2026-02-12T16:39:41.488 INFO:teuthology.task.kernel:Running kernel on trial187: 5.14.0-645.el9.x86_64 2026-02-12T16:39:41.488 DEBUG:teuthology.orchestra.run.trial187:> sudo yum install -y kernel 2026-02-12T16:39:41.489 INFO:teuthology.orchestra.run.trial105.stdout:5.14.0-645.el9.x86_64 2026-02-12T16:39:41.489 INFO:teuthology.task.kernel:Running kernel on trial105: 5.14.0-645.el9.x86_64 2026-02-12T16:39:41.489 DEBUG:teuthology.orchestra.run.trial105:> sudo yum install -y kernel 2026-02-12T16:39:43.236 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.9 MB 00:01 2026-02-12T16:39:43.598 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.9 MB 00:01 2026-02-12T16:39:46.290 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-12T16:39:46.870 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-12T16:39:50.240 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-12T16:39:51.906 INFO:teuthology.orchestra.run.trial105.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 20 kB 00:00 2026-02-12T16:39:52.576 INFO:teuthology.orchestra.run.trial105.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-12T16:39:55.830 INFO:teuthology.orchestra.run.trial105.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-12T16:39:56.891 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - CRB 965 kB/s | 7.8 MB 00:08 2026-02-12T16:39:56.892 INFO:teuthology.orchestra.run.trial105.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T16:39:56.912 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-12T16:39:56.913 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-12T16:39:56.913 INFO:teuthology.orchestra.run.trial105.stdout: Package Architecture Version Repository Size 2026-02-12T16:39:56.913 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout:Install 4 Packages 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-12T16:39:56.914 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 88 M 2026-02-12T16:39:56.915 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 135 M 2026-02-12T16:39:56.915 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-12T16:39:57.239 INFO:teuthology.orchestra.run.trial105.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 3.3 MB/s | 768 kB 00:00 2026-02-12T16:39:57.398 INFO:teuthology.orchestra.run.trial105.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 44 MB/s | 17 MB 00:00 2026-02-12T16:39:57.567 INFO:teuthology.orchestra.run.trial105.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 94 MB/s | 31 MB 00:00 2026-02-12T16:39:57.622 INFO:teuthology.orchestra.run.trial105.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 65 MB/s | 40 MB 00:00 2026-02-12T16:39:57.622 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-12T16:39:57.623 INFO:teuthology.orchestra.run.trial105.stdout:Total 124 MB/s | 88 MB 00:00 2026-02-12T16:39:57.813 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-12T16:39:58.001 INFO:teuthology.orchestra.run.trial187.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 20 kB 00:00 2026-02-12T16:39:58.017 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-12T16:39:58.017 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-12T16:39:58.363 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-12T16:39:58.363 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-12T16:39:58.939 INFO:teuthology.orchestra.run.trial187.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-12T16:39:59.450 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-12T16:39:59.735 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T16:39:59.755 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T16:40:01.531 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T16:40:01.560 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T16:40:02.134 INFO:teuthology.orchestra.run.trial187.stdout:lab-extras 1.0 MB/s | 50 kB 00:00 2026-02-12T16:40:03.211 INFO:teuthology.orchestra.run.trial187.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T16:40:03.231 INFO:teuthology.orchestra.run.trial187.stdout:Dependencies resolved. 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout:================================================================================ 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout: Package Architecture Version Repository Size 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout:================================================================================ 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout:Installing: 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout:Installing dependencies: 2026-02-12T16:40:03.232 INFO:teuthology.orchestra.run.trial187.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout:Transaction Summary 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout:================================================================================ 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout:Install 4 Packages 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout:Total download size: 88 M 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout:Installed size: 135 M 2026-02-12T16:40:03.233 INFO:teuthology.orchestra.run.trial187.stdout:Downloading Packages: 2026-02-12T16:40:03.430 INFO:teuthology.orchestra.run.trial187.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 8.5 MB/s | 768 kB 00:00 2026-02-12T16:40:03.519 INFO:teuthology.orchestra.run.trial187.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 96 MB/s | 17 MB 00:00 2026-02-12T16:40:03.653 INFO:teuthology.orchestra.run.trial187.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 138 MB/s | 31 MB 00:00 2026-02-12T16:40:03.707 INFO:teuthology.orchestra.run.trial187.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 108 MB/s | 40 MB 00:00 2026-02-12T16:40:03.709 INFO:teuthology.orchestra.run.trial187.stdout:-------------------------------------------------------------------------------- 2026-02-12T16:40:03.709 INFO:teuthology.orchestra.run.trial187.stdout:Total 185 MB/s | 88 MB 00:00 2026-02-12T16:40:03.900 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction check 2026-02-12T16:40:04.103 INFO:teuthology.orchestra.run.trial187.stdout:Transaction check succeeded. 2026-02-12T16:40:04.104 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction test 2026-02-12T16:40:04.449 INFO:teuthology.orchestra.run.trial187.stdout:Transaction test succeeded. 2026-02-12T16:40:04.449 INFO:teuthology.orchestra.run.trial187.stdout:Running transaction 2026-02-12T16:40:04.651 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T16:40:04.658 INFO:teuthology.orchestra.run.trial105.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:05.546 INFO:teuthology.orchestra.run.trial187.stdout: Preparing : 1/1 2026-02-12T16:40:05.829 INFO:teuthology.orchestra.run.trial187.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T16:40:05.848 INFO:teuthology.orchestra.run.trial187.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T16:40:07.619 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T16:40:07.648 INFO:teuthology.orchestra.run.trial187.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T16:40:07.688 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:10.734 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T16:40:10.740 INFO:teuthology.orchestra.run.trial187.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:13.771 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:38.071 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:38.092 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:38.263 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:38.263 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T16:40:38.263 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T16:40:38.264 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T16:40:38.315 INFO:teuthology.orchestra.run.trial105.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-12T16:40:38.316 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-12T16:40:38.369 DEBUG:teuthology.orchestra.run.trial105:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T16:40:38.396 INFO:teuthology.orchestra.run.trial105.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.397 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T16:40:38.397 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T16:40:38.397 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T16:40:38.397 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T16:40:38.397 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T16:40:38.397 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial105.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T16:40:38.398 DEBUG:teuthology.orchestra.run.trial105:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T16:40:38.459 INFO:teuthology.orchestra.run.trial105.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.460 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T16:40:38.461 DEBUG:teuthology.orchestra.run.trial105:> sudo rpm -qi grub2-tools 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Name : grub2-tools 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Epoch : 1 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Version : 2.06 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Release : 118.el9 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Architecture: x86_64 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T16:40:38.528 INFO:teuthology.orchestra.run.trial105.stdout:Group : Unspecified 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Size : 8393909 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:License : GPLv3+ 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Packager : builder@centos.org 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Vendor : CentOS 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Summary : Support tools for GRUB. 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:Description : 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-12T16:40:38.529 INFO:teuthology.orchestra.run.trial105.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T16:40:38.530 INFO:teuthology.orchestra.run.trial105.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T16:40:38.530 INFO:teuthology.orchestra.run.trial105.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T16:40:38.530 INFO:teuthology.orchestra.run.trial105.stdout:hardware devices. 2026-02-12T16:40:38.530 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-12T16:40:38.530 INFO:teuthology.orchestra.run.trial105.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T16:40:38.531 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T16:40:38.531 INFO:teuthology.task.kernel:Updating grub on trial105 to boot 5.14.0-677.el9.x86_64 2026-02-12T16:40:38.531 DEBUG:teuthology.orchestra.run.trial105:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T16:40:38.595 INFO:teuthology.orchestra.run.trial105.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T16:40:38.597 DEBUG:teuthology.orchestra.run.trial105:> sudo command -v grubby && echo yes || echo no 2026-02-12T16:40:38.660 INFO:teuthology.orchestra.run.trial105.stdout:/sbin/grubby 2026-02-12T16:40:38.662 INFO:teuthology.orchestra.run.trial105.stdout:yes 2026-02-12T16:40:38.662 DEBUG:teuthology.orchestra.run.trial105:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T16:40:38.726 INFO:teuthology.orchestra.run.trial105.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T16:40:38.727 DEBUG:teuthology.orchestra.run.trial105:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T16:40:38.799 DEBUG:teuthology.orchestra.run.trial105:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T16:40:39.003 INFO:teuthology.orchestra.run.trial105.stderr:Generating grub configuration file ... 2026-02-12T16:40:39.066 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T16:40:39.073 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T16:40:39.321 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T16:40:39.327 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T16:40:39.359 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T16:40:39.366 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T16:40:39.389 INFO:teuthology.orchestra.run.trial105.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T16:40:39.396 INFO:teuthology.orchestra.run.trial105.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T16:40:39.477 INFO:teuthology.orchestra.run.trial105.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T16:40:39.485 INFO:teuthology.orchestra.run.trial105.stderr:done 2026-02-12T16:40:39.488 DEBUG:teuthology.orchestra.run.trial105:> test -d /sys/firmware/efi 2026-02-12T16:40:39.504 DEBUG:teuthology.orchestra.run.trial105:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T16:40:39.568 INFO:teuthology.orchestra.run.trial105.stdout:/boot/efi/EFI/BOOT 2026-02-12T16:40:39.568 INFO:teuthology.orchestra.run.trial105.stdout:/boot/efi/EFI/centos 2026-02-12T16:40:39.570 DEBUG:teuthology.orchestra.run.trial105:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T16:40:39.637 INFO:teuthology.orchestra.run.trial105.stdout:no 2026-02-12T16:40:39.637 DEBUG:teuthology.orchestra.run.trial105:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T16:40:39.700 INFO:teuthology.orchestra.run.trial105.stdout:yes 2026-02-12T16:40:39.701 DEBUG:teuthology.orchestra.run.trial105:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T16:40:39.765 DEBUG:teuthology.orchestra.run.trial105:> sudo shutdown -r now 2026-02-12T16:40:39.838 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T16:40:44.238 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:44.260 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:44.325 INFO:teuthology.orchestra.run.trial187.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:44.325 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T16:40:44.325 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T16:40:44.325 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout:Installed: 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-12T16:40:44.378 INFO:teuthology.orchestra.run.trial187.stdout:Complete! 2026-02-12T16:40:44.435 DEBUG:teuthology.orchestra.run.trial187:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T16:40:44.460 INFO:teuthology.orchestra.run.trial187.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.462 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T16:40:44.462 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T16:40:44.462 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T16:40:44.462 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T16:40:44.462 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T16:40:44.462 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial187.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T16:40:44.462 DEBUG:teuthology.orchestra.run.trial187:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T16:40:44.524 INFO:teuthology.orchestra.run.trial187.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.525 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T16:40:44.525 DEBUG:teuthology.orchestra.run.trial187:> sudo rpm -qi grub2-tools 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Name : grub2-tools 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Epoch : 1 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Version : 2.06 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Release : 118.el9 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Architecture: x86_64 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T16:40:44.593 INFO:teuthology.orchestra.run.trial187.stdout:Group : Unspecified 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Size : 8393909 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:License : GPLv3+ 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Packager : builder@centos.org 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Vendor : CentOS 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Summary : Support tools for GRUB. 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout:Description : 2026-02-12T16:40:44.594 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-12T16:40:44.595 INFO:teuthology.orchestra.run.trial187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T16:40:44.595 INFO:teuthology.orchestra.run.trial187.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T16:40:44.595 INFO:teuthology.orchestra.run.trial187.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T16:40:44.595 INFO:teuthology.orchestra.run.trial187.stdout:hardware devices. 2026-02-12T16:40:44.595 INFO:teuthology.orchestra.run.trial187.stdout: 2026-02-12T16:40:44.595 INFO:teuthology.orchestra.run.trial187.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T16:40:44.596 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T16:40:44.596 INFO:teuthology.task.kernel:Updating grub on trial187 to boot 5.14.0-677.el9.x86_64 2026-02-12T16:40:44.596 DEBUG:teuthology.orchestra.run.trial187:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T16:40:44.661 INFO:teuthology.orchestra.run.trial187.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T16:40:44.662 DEBUG:teuthology.orchestra.run.trial187:> sudo command -v grubby && echo yes || echo no 2026-02-12T16:40:44.726 INFO:teuthology.orchestra.run.trial187.stdout:/sbin/grubby 2026-02-12T16:40:44.728 INFO:teuthology.orchestra.run.trial187.stdout:yes 2026-02-12T16:40:44.728 DEBUG:teuthology.orchestra.run.trial187:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T16:40:44.792 INFO:teuthology.orchestra.run.trial187.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T16:40:44.793 DEBUG:teuthology.orchestra.run.trial187:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T16:40:44.865 DEBUG:teuthology.orchestra.run.trial187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T16:40:45.074 INFO:teuthology.orchestra.run.trial187.stderr:Generating grub configuration file ... 2026-02-12T16:40:45.137 INFO:teuthology.orchestra.run.trial187.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T16:40:45.144 INFO:teuthology.orchestra.run.trial187.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T16:40:45.397 INFO:teuthology.orchestra.run.trial187.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T16:40:45.403 INFO:teuthology.orchestra.run.trial187.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T16:40:45.436 INFO:teuthology.orchestra.run.trial187.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T16:40:45.442 INFO:teuthology.orchestra.run.trial187.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T16:40:45.466 INFO:teuthology.orchestra.run.trial187.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T16:40:45.473 INFO:teuthology.orchestra.run.trial187.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T16:40:45.557 INFO:teuthology.orchestra.run.trial187.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T16:40:45.565 INFO:teuthology.orchestra.run.trial187.stderr:done 2026-02-12T16:40:45.567 DEBUG:teuthology.orchestra.run.trial187:> test -d /sys/firmware/efi 2026-02-12T16:40:45.583 DEBUG:teuthology.orchestra.run.trial187:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T16:40:45.648 INFO:teuthology.orchestra.run.trial187.stdout:/boot/efi/EFI/BOOT 2026-02-12T16:40:45.648 INFO:teuthology.orchestra.run.trial187.stdout:/boot/efi/EFI/centos 2026-02-12T16:40:45.650 DEBUG:teuthology.orchestra.run.trial187:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T16:40:45.714 INFO:teuthology.orchestra.run.trial187.stdout:no 2026-02-12T16:40:45.715 DEBUG:teuthology.orchestra.run.trial187:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T16:40:45.780 INFO:teuthology.orchestra.run.trial187.stdout:yes 2026-02-12T16:40:45.781 DEBUG:teuthology.orchestra.run.trial187:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T16:40:45.844 DEBUG:teuthology.orchestra.run.trial187:> sudo shutdown -r now 2026-02-12T16:40:45.919 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T16:41:09.831 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T16:41:09.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:41:09.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:41:15.893 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T16:41:15.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-12T16:41:15.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:41:32.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:41:41.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:41:41.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:41:44.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:41:56.679 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:41:56.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:41:59.773 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:42:14.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:42:14.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:42:15.897 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T16:42:17.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:42:24.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-12T16:42:24.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:42:25.040 DEBUG:teuthology.orchestra.run.trial187:> true 2026-02-12T16:42:25.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial187.front.sepia.ceph.com' 2026-02-12T16:42:25.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T16:42:25.199 DEBUG:teuthology.orchestra.run.trial187:> uname -r 2026-02-12T16:42:25.256 INFO:teuthology.orchestra.run.trial187.stdout:5.14.0-677.el9.x86_64 2026-02-12T16:42:25.256 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T16:42:25.256 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T16:42:25.257 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T16:42:26.257 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-12T16:42:26.258 DEBUG:teuthology.orchestra.run.trial187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T16:42:26.287 INFO:teuthology.orchestra.run.trial187.stdout:ttyS1 2026-02-12T16:42:26.310 DEBUG:teuthology.parallel:result is None 2026-02-12T16:42:35.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:42:35.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:42:38.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:42:59.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:42:59.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:43:03.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:43:27.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:43:27.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:43:30.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:43:57.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:43:57.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:44:00.157 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:44:30.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:44:30.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:44:33.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:45:06.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:45:06.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:45:09.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:45:45.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:45:45.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:45:48.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:46:27.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:46:27.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:46:30.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:47:00.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:47:00.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:47:03.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:47:03.645 WARNING:teuthology.contextutil:'reconnect to trial105' reached maximum tries (13) after waiting for 300 seconds 2026-02-12T16:47:03.645 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T16:47:03.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:47:03.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:47:06.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:47:15.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:47:15.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:47:18.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:47:30.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:47:30.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:47:33.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:47:36.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-12T16:47:36.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T16:47:39.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.105 2026-02-12T16:47:39.997 WARNING:teuthology.contextutil:'reconnect to trial105' reached maximum tries (4) after waiting for 30 seconds 2026-02-12T16:47:39.997 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/kernel.py", line 182, in need_to_install ctx.cluster.only(role).run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 574, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to trial105 2026-02-12T16:47:39.998 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/kernel.py", line 1374, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/kernel.py", line 1481, in process_role wait_for_reboot(ctx, {role: need_version}, timeout, config) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/kernel.py", line 710, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/kernel.py", line 182, in need_to_install ctx.cluster.only(role).run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 574, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to trial105 2026-02-12T16:47:39.999 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T16:47:40.010 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T16:47:40.044 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} failure_reason: Failed to reconnect to trial105 owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-12T16:47:40.044 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T16:47:40.143 INFO:teuthology.run:FAIL