GBU College Logo
Sign in with GBU Microsoft

Brain-to-Speech: Prosody Feature Engineering and Transformer-Based Reconstruction

Artificial Intelligence, Data and Robotics: Foundations, Transformations and Future Directions | 2026

Paper Details

Authors: Al-Radhi M.S.; Németh G.; Tchechmedjiev A.; Xu B.

DOI: 10.1007/978-3-032-10561-5_16

Journal: Artificial Intelligence, Data and Robotics: Foundations, Transformations and Future Directions

Year: 2026

Publisher: Springer Nature

Document Type: Book chapter

Open Access: All Open Access; Gold Open Access; Green Open Access

Cited by: 0

Abstract

This chapter presents a novel approach to brain-to-speech (BTS) synthesis from intracranial electroencephalography (iEEG) data, emphasizing prosody-aware feature engineering and advanced transformer-based models for high-fidelity speech reconstruction. Driven by the increasing interest in decoding speech directly from brain activity, this work integrates neuroscience, artificial intelligence, and signal processing to generate accurate and natural speech. We introduce a novel pipeline for extracting key prosodic features directly from complex brain iEEG signals, including intonation, pitch, and rhythm. To effectively utilize these crucial features for natural-sounding speech, we employ advanced deep learning models. Furthermore, this chapter introduces a novel transformer encoder architecture specifically designed for brain-to-speech tasks. Unlike conventional models, our architecture integrates the extracted prosodic features to significantly enhance speech reconstruction, resulting in generated speech with improved intelligibility and expressiveness. A detailed evaluation demonstrates superior performance over established baseline methods, such as traditional Griffin-Lim and CNN-based reconstruction, across both quantitative and perceptual metrics. By demonstrating these advancements in feature extraction and transformer-based learning, this chapter contributes to the growing field of AI-driven neuroprosthetics, paving the way for assistive technologies that restore communication for individuals with speech impairments. Finally, we discuss promising future research directions, including the integration of diffusion models and real-time inference systems. © The Editor(s) (if applicable) and The Author(s) 2026.

Keywords

Brain AI; iEEG; Neural signals; Prosody feature; Transformer model