DAMO-NLP-SG / SeaLLMs-AudioLinks
☆49Updated 3 months ago
Alternatives and similar repositories for SeaLLMs-Audio
Users that are interested in SeaLLMs-Audio are comparing it to the libraries listed below
Sorting:
- ☆118Updated 2 months ago
- ☆69Updated last month
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated 9 months ago
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Updated last year
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆83Updated last month
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated last year
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆77Updated last year
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆55Updated 5 months ago
- LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models☆25Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆66Updated last year
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated 11 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆53Updated last year
- ☆38Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆103Updated 6 months ago
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆82Updated 4 months ago
- Official release of StyleTalk dataset.☆70Updated last year
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆35Updated 7 months ago
- Collection of scripts from mHuBERT-147.☆32Updated last year
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆115Updated 2 months ago
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆94Updated 4 months ago
- The official repo of "WhiStress: Enriching Transcriptions with Sentence Stress Detection" (Interspeech 2025)☆30Updated 3 months ago
- ☆37Updated 7 months ago
- ☆17Updated 5 months ago
- ☆19Updated 4 months ago
- ☆23Updated last year
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆22Updated 5 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆25Updated last year
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated last year
- An official implementation of Style-Talker for Spoken Dialogue Generation☆23Updated 10 months ago
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆176Updated last month