Code for voicing silent speech from EMG. Official repository for the papers "Digital Voicing of Silent Speech" at EMNLP 2020 and "An Improved Model for Voicing Silent Speech" at ACL 2021. Also includes code for converting silent speech to text.
☆165Apr 30, 2024Updated last year
Alternatives and similar repositories for silent_speech
Users that are interested in silent_speech are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for "A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognition"☆17Mar 14, 2024Updated 2 years ago
- Corresponding source code for the study "Real-time Synthesis of Imagined Speech Processes from Minimally Invasive Recordings of Neural Ac…☆11Jul 30, 2021Updated 4 years ago
- Surface electromyography based gesture recognition based on dual-stream CNN☆13Jun 7, 2023Updated 2 years ago
- Syllable Segmentation and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model☆35Aug 27, 2023Updated 2 years ago
- ☆60May 29, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The code repository for "MB2C: Multimodal Bidirectional Cycle Consistency for Learning Robust Visual Neural Representations" in PyTorch☆22Nov 24, 2024Updated last year
- The code for Template-GPT-2 Generation Model for Logic2Text Dataset☆18Jun 1, 2020Updated 5 years ago
- Code for the paper, SAMoSA - Sensing Activities with Motion and Sub-sampled Audio☆18Jan 24, 2023Updated 3 years ago
- Exploration on introducing discrete codex and raw wave decoding to realize Brain-to-Text translation.☆191May 19, 2025Updated 11 months ago
- ☆53Sep 20, 2024Updated last year
- ☆14Mar 24, 2023Updated 3 years ago
- ☆114Apr 8, 2024Updated 2 years ago
- The source code for the the manuscript titled [M. AbdelMaseeh, T. W. Chen and D. W. Stashuk, "Extraction and Classification of Multichann…☆23Sep 7, 2021Updated 4 years ago
- ☆31Apr 3, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Pretrained decoders for intracortical BCI.☆33Jan 26, 2026Updated 2 months ago
- A repo to do interpretability of pre-trained acoustic models☆15Oct 15, 2023Updated 2 years ago
- A framework for simplying BCI workflow in clinical applications☆23Updated this week
- Training and evaluation pipeline for MEG and EEG brain signal encoding and decoding using deep learning. Code for our paper "Decoding spe…☆468Mar 12, 2024Updated 2 years ago
- Acoustic distance measure for comparing pronunciations☆17Aug 2, 2022Updated 3 years ago
- Code associated with the paper titled "A high-performance neuroprosthesis for speech decoding and avatar control" , published in Nature i…☆70Aug 23, 2023Updated 2 years ago
- ☆10Aug 3, 2020Updated 5 years ago
- Detect leakages in machine learning datasets using complex numbers and NANs☆13Jul 23, 2020Updated 5 years ago
- Code repo of the paper "A Multi-stream Convolutional Neural Network for sEMG-based Gesture Recognition in Musclecomputer interface".☆25May 15, 2019Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of the DIVA model of speech acquisition and production using PyTorch☆22Jan 18, 2023Updated 3 years ago
- EV-Action: Electromyography-Vision Multi-Modal Action Dataset☆21Nov 11, 2020Updated 5 years ago
- Voice activity detection and speaker gender segmentation audiovisual corpus☆16Jan 20, 2025Updated last year
- Deep learning based solution to automatically analyze medical images for malaria testing☆16May 1, 2019Updated 6 years ago
- ☆10Mar 21, 2018Updated 8 years ago
- i. A practical application of Transformer (ViT) on 2-D physiological signal (EEG) classification tasks. Also could be tried with EMG, EOG…☆329Mar 23, 2023Updated 3 years ago
- ☆10Mar 20, 2021Updated 5 years ago
- ML-driven tongue animation (CVPR'22)☆51Mar 29, 2022Updated 4 years ago
- Implementation of Insertion-deletion Denoising Diffusion Probabilistic Models☆30May 31, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Machine learning code implemented for hand gesture recognition using EMG data from the Ninapro db1 database. Report Link: https://drive.…☆47Jan 23, 2024Updated 2 years ago
- An High-resolution implementation of HiFi-GAN Vocoder for Voice Conversion.☆32Apr 10, 2023Updated 3 years ago
- BCI/NF real-time processing and classification pipeline☆21Updated this week
- The goal of this 3D prediction from single RGB image is to predict the 3D geometry and structure of objects from a single RGB image using…☆13Feb 11, 2020Updated 6 years ago
- Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation☆205Jul 29, 2025Updated 8 months ago
- Documentation for Reproducing & Using the OpenBCI cEEGrid Adapter☆61Sep 25, 2024Updated last year
- Python package of MP-SENet from Explicit Estimation of Magnitude and Phase Spectra in Parallel for High-Quality Speech Enhancement.☆21Nov 1, 2024Updated last year