Alternatives and similar repositories for GMA

Users that are interested in GMA are comparing it to the libraries listed below

• 0nutation / DUB
  Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)
  ☆28Updated 2 years ago
• ictnlp / DASpeech
  Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".
  ☆63Updated last year
• cwang621 / blsp-emo
  BLSP-Emo: Towards Empathetic Large Speech-Language Models
  ☆49Updated last year
• XiaomiMiMo / MiMo-Audio-Tokenizer
  A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.
  ☆95Updated 3 weeks ago
• cwang621 / blsp
  BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing
  ☆55Updated last year
• ReneeYe / ConST
  code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)
  ☆64Updated 3 years ago
• DanielLin94144 / StyleTalk
  Official release of StyleTalk dataset.
  ☆70Updated last year
• KexinHUANG19 / InstructTTSEval
  ☆19Updated 3 months ago
• huangcanan / Awesome-Large-Speech-Model
  A repository used to organize content related to Large Speech(Audio) Model, including paper, data, applications, tools and so on.
  ☆21Updated 8 months ago
• thunlp / duplex-model
  ☆41Updated last year
• amphionspace / SD-Eval
  [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words
  ☆51Updated last year
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆119Updated 10 months ago
• dqqcasia / st
  End-to-end Speech Translation
  ☆35Updated 4 years ago
• openaudiolab / LLaST
  LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models
  ☆25Updated last year
• shuaijiang / Ke-Omni-R
  Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU
  ☆49Updated 3 months ago
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆140Updated last year
• OpenMOSS / MOSS-Speech
  MOSS-Speech is a true speech-to-speech large language model without text guidance.
  ☆47Updated last week
• jishengpeng / WavReward
  WavReward: Spoken Dialogue Models With Generalist Reward Evaluators
  ☆53Updated 4 months ago
• google-research-datasets / LLAMA1-Test-Set
  We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…
  ☆21Updated last year
• blmoistawinde / fense
  Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval…
  ☆21Updated 2 years ago
• mct10 / CoBERT
  Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
  ☆47Updated last year
• xuchenneu / SATE
  End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding
  ☆26Updated 4 years ago
• Sakshi113 / MMAU
  ☆113Updated last month
• youngsheen / GPST
  [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer
  ☆62Updated 11 months ago
• ictnlp / CMOT
  Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"
  ☆18Updated 11 months ago
• ictnlp / SLED-TTS
  Streamable Text-to-Speech model using a language modeling approach, without vector quantization
  ☆98Updated 4 months ago
• ictnlp / STEMM
  Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".
  ☆36Updated last year
• yangdongchao / ALMTokenizer
  The demo page for ALMTokenizer
  ☆52Updated 5 months ago
• Rongjiehuang / awesome-speech-to-speech-translation
  List of direct speech-to-speech translation papers.
  ☆38Updated 2 years ago
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆45Updated 3 months ago