FAIR Sequence Modeling Toolkit 2
☆1,119Updated this week
Alternatives and similar repositories for fairseq2
Users that are interested in fairseq2 are comparing it to the libraries listed below
Sorting:
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.☆868Oct 10, 2025Updated 4 months ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆297Updated this week
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆152Sep 14, 2023Updated 2 years ago
- switch2ai - A JetBrains IDE plugin enabling seamless collaboration between JetBrains IDEs and various AI agents (Cursor, Qoder, Claude co…☆170Nov 11, 2025Updated 3 months ago
- [ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling☆1,270Mar 2, 2025Updated last year
- Foundational Models for State-of-the-Art Speech and Text Translation☆11,762Nov 14, 2024Updated last year
- Audio Codec Speech processing Universal PERformance Benchmark☆297Jan 8, 2026Updated last month
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆647Jun 9, 2024Updated last year
- An Open-source Streaming High-fidelity Neural Audio Codec☆498Mar 4, 2025Updated 11 months ago
- SimulEval: A General Evaluation Toolkit for Simultaneous Translation☆122Sep 13, 2024Updated last year
- Gotta Hear Them All: Towards Sound Source Aware Audio Generation.☆67Nov 15, 2025Updated 3 months ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆506Sep 26, 2024Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,170Sep 30, 2025Updated 5 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆192Jul 12, 2024Updated last year
- Self-Supervised Speech Pre-training and Representation Learning Toolkit☆2,530Jun 13, 2025Updated 8 months ago
- The Open Source Code of UniAudio☆605Jul 22, 2024Updated last year
- [CVPR'25] Official PyTorch implementation of AvatarArtist: Open-Domain 4D Avatarization.☆277Jun 14, 2025Updated 8 months ago
- [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"☆367Sep 3, 2024Updated last year
- Unified-Modal Speech-Text Pre-Training for Spoken Language Processing☆1,433Apr 24, 2024Updated last year
- your finance bro Agent for trading and investing☆108Nov 8, 2025Updated 3 months ago
- SALMONN family: A suite of advanced multi-modal LLMs☆1,390Feb 3, 2026Updated 3 weeks ago
- Library for Textless Spoken Language Processing☆555Aug 29, 2023Updated 2 years ago
- Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis☆1,069Aug 7, 2024Updated last year
- Tools for handling multimodal data in machine learning projects.☆1,114Updated this week
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆974Jan 15, 2026Updated last month
- AcademiCodec: An Open Source Audio Codec Model for Academic Research☆669Dec 27, 2023Updated 2 years ago
- UniSpeech - Large Scale Self-Supervised Learning for Speech☆479Apr 5, 2024Updated last year
- Awesome speech/audio LLMs, representation learning, and codec models☆1,210Aug 13, 2025Updated 6 months ago
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆441Jan 25, 2024Updated 2 years ago
- ☆163Sep 19, 2022Updated 3 years ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆96Nov 20, 2024Updated last year
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆724Oct 16, 2025Updated 4 months ago
- An Audio Language model for Audio Tasks☆319Apr 19, 2024Updated last year
- The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.☆1,873Jul 5, 2024Updated last year
- This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.☆601Sep 18, 2023Updated 2 years ago
- PyTorch extensions for high performance and large scale training.☆3,400Apr 26, 2025Updated 10 months ago
- SpeechGPT Series: Speech Large Language Models☆1,405Jul 22, 2024Updated last year
- UniVoice: Unifying Autoregressive ASR and Flow-Matching based TTS with Large Language Models☆111Oct 30, 2025Updated 4 months ago
- Dynamic human image animation with strong identity preservation, heterogeneous character driving, and controllable backgrounds.☆140May 23, 2025Updated 9 months ago