Alternatives and similar repositories for GMA

Users that are interested in GMA are comparing it to the libraries listed below

• 0nutation / DUB
  Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)
  ☆28Updated 2 years ago
• ictnlp / DASpeech
  Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
  ☆63Updated last year
• XiaomiMiMo / MiMo-Audio-Tokenizer
  A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.
  ☆115Updated 2 months ago
• KexinHUANG19 / InstructTTSEval
  ☆19Updated 4 months ago
• amphionspace / SD-Eval
  [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words
  ☆53Updated last year
• ReneeYe / ConST
  code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
  ☆64Updated 3 years ago
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆70Updated last year
• cwang621 / blsp
  BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing
  ☆56Updated last year
• cwang621 / blsp-emo
  BLSP-Emo: Towards Empathetic Large Speech-Language Models
  ☆53Updated last year
• OpenMOSS / MOSS-Speech
  MOSS-Speech is a true speech-to-speech large language model without text guidance.
  ☆64Updated last month
• jishengpeng / WavReward
  WavReward: Spoken Dialogue Models With Generalist Reward Evaluators
  ☆54Updated 6 months ago
• dqqcasia / st
  End-to-end Speech Translation
  ☆35Updated 4 years ago
• walker-hyf / NCSSD
  Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)
  ☆62Updated last year
• youngsheen / GPST
  [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer
  ☆66Updated last year
• openaudiolab / LLaST
  LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
  ☆25Updated last year
• yangdongchao / ALMTokenizer
  The demo page for ALMTokenizer
  ☆55Updated 7 months ago
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆141Updated last year
• Rongjiehuang / awesome-speech-to-speech-translation
  List of direct speech-to-speech translation papers.
  ☆38Updated 2 years ago
• mct10 / CoBERT
  Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
  ☆48Updated 2 years ago
• X-LANCE / UniCATS-CTX-txt2vec
  [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS
  ☆64Updated last year
• huangcanan / Awesome-Large-Speech-Model
  A repository used to organize content related to Large Speech(Audio) Model, including paper, data, applications, tools and so on.
  ☆22Updated last week
• ictnlp / SLED-TTS
  Streamable Text-to-Speech model using a language modeling approach, without vector quantization
  ☆103Updated 6 months ago
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆46Updated 3 weeks ago
• google-research-datasets / LLAMA1-Test-Set
  We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…
  ☆23Updated last year
• xuchennlp / S2T
  The project for speech translation
  ☆12Updated 2 years ago
• shuaijiang / Ke-Omni-R
  Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU
  ☆55Updated 5 months ago
• NKU-HLT / DIFFA
  [AAAI 2026] DIFFA: Large Language Diffusion Models Can Listen and Understand
  ☆30Updated last week
• XiaomiMiMo / MiMo-Audio-Eval
  ☆69Updated last month
• NKU-HLT / KNN-CTC
  [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels
  ☆42Updated last year
• ddlBoJack / Omni-Captioner
  Data Pipeline, Models, and Benchmark for Omni-Captioner.
  ☆87Updated last month