ictnlp / CRESSLinks
Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".
☆17Updated 2 years ago
Alternatives and similar repositories for CRESS
Users that are interested in CRESS are comparing it to the libraries listed below
Sorting:
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆55Updated last year
- A repository used to organize content related to Large Speech(Audio) Model, including paper, data, applications, tools and so on.☆22Updated 9 months ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆64Updated 3 years ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated 2 years ago
- [INTERSPEECH 2023] Knowledge Transfer from Pre-trained Language Models to Cif-based Recognizers via Hierarchical Distillation☆40Updated 2 years ago
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆32Updated last year
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated 10 months ago
- llama-omni训练代码复现☆68Updated 9 months ago
- End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding☆26Updated 4 years ago
- Code for ACL 2023 main conference paper "CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation"☆18Updated last year
- ☆114Updated last month
- ☆27Updated 3 years ago
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆172Updated 4 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆169Updated 6 months ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆52Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 10 months ago
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆28Updated 2 years ago
- Code for ACL 2022 main conference paper "Modeling Dual Read/Write Paths for Simultaneous Machine Translation"☆12Updated 3 years ago
- This is a repository for fine-tuning Qwen2-Audio, currently supporting Distributed Data Parallel (DDP) and DeepSpeed.☆43Updated 3 months ago
- The official repository of Dynamic-SUPERB.☆192Updated 4 months ago
- Qualifying Exam Preparing☆15Updated 5 months ago
- ☆37Updated 2 years ago
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 3 years ago
- ☆21Updated last year
- [ACL 2024] An easily extensible framework for simultaneous, text-to-text neural machine translation (SimulMT) for LLMs.☆15Updated 6 months ago
- [ICASSP 2020] CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition (A PyTorch implementation of Continuous Integrate-and-…☆77Updated 9 months ago
- A Survey of Spoken Dialogue Models (60 pages)☆310Updated 11 months ago
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆210Updated last year
- Code for EMNLP 2022 main conference paper "Information-Transport-based Policy for Simultaneous Translation"☆13Updated 2 years ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆186Updated 11 months ago