CASIA-LM / OpenS2SLinks
OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model
☆20Updated last week
Alternatives and similar repositories for OpenS2S
Users that are interested in OpenS2S are comparing it to the libraries listed below
Sorting:
- ☆11Updated 4 months ago
- ☆37Updated last year
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆75Updated last month
- ☆86Updated last week
- ☆16Updated 3 weeks ago
- A project for tri-modal LLM benchmarking and instruction tuning.☆40Updated 3 months ago
- a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.☆20Updated 3 months ago
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆88Updated 2 weeks ago
- Collection of works for evaluating (and analyzing) large audio-language models (LALMs)☆31Updated last week
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated 8 months ago
- BLSP-Emo: Towards Empathetic Large Speech-Language Models☆47Updated last year
- ☆38Updated 10 months ago
- Official Repository of IJCAI 2024 Paper: "BATON: Aligning Text-to-Audio Model with Human Preference Feedback"☆29Updated 4 months ago
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated 11 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated 11 months ago
- ☆47Updated last month
- Official release of StyleTalk dataset.☆67Updated last year
- Official PyTorch implementation for "MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens…☆31Updated last month
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆106Updated 7 months ago
- Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆50Updated this week
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆48Updated 3 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆15Updated 7 months ago
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆33Updated last month
- ☆18Updated 10 months ago
- ☆14Updated 7 months ago
- [ACM MM 2023] Official PyTorch implementation of "Emo-DNA: Emotion Decoupling and Alignment Learning for Cross-Corpus Speech Emotion Reco…☆11Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆19Updated last year
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated 2 years ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆59Updated 8 months ago
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆72Updated 8 months ago