ictnlp / CRESS
Code for ACL 2023 main conference paper "Understanding and Bridging the Modality Gap for Speech Translation".
☆16Updated last year
Related projects ⓘ
Alternatives and complementary repositories for CRESS
- BLSP: Bootstrapping Langauge-Speech Pre-training via Behavior Alignment of Continuation Writing☆45Updated 8 months ago
- ☆28Updated 2 years ago
- code for paper "Cross-modal Contrastive Learning for Speech Translation" (NAACL 2022)☆62Updated 2 years ago
- The project for speech translation☆11Updated last year
- [ICASSP 2024] KNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels☆28Updated 8 months ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆36Updated last year
- Code for ACL 2023 main conference paper "Back Translation for Speech-to-text Translation Without Transcripts".☆13Updated last year
- A fast speech-to-speech & speech-to-text translation model that supports simultaneous decoding and offers 28× speedup.☆60Updated last month
- Code and pretrained models for "DUB: Discrete Unit Back-translation for Speech Translation" (ACL 2023 Findings)☆26Updated last year
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Updated 2 years ago
- End-to-End Speech Processing Toolkit☆11Updated this week
- [ICASSP 2022] Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection☆25Updated last year
- [TASLP 2024] Textless Unit-to-Unit training for Many-to-Many Multilingual Speech-to-Speech Translation☆23Updated 2 months ago
- End-to-end Speech Translation with Stacked Acoustic-and-Textual Encoding☆24Updated 3 years ago
- End-to-end Speech Translation☆36Updated 3 years ago
- [ACL 2024] An easily extensible framework for simultaneous, text-to-text neural machine translation (SimulMT) for LLMs.☆11Updated this week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆56Updated 3 months ago
- ☆34Updated 2 years ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 5 months ago
- List of direct speech-to-speech translation papers.☆31Updated last year
- [INTERSPEECH 2023] Knowledge Transfer from Pre-trained Language Models to Cif-based Recognizers via Hierarchical Distillation☆35Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆19Updated 3 months ago
- Implementation of CTC alignment-based single step non-autoregressive transformer☆12Updated last year
- ☆11Updated 6 months ago
- Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech und…☆43Updated last year
- [ICASSP 2020] CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition (A PyTorch implementation of Continuous Integrate-and-…☆67Updated last year
- ASCEND Chinese-English code-switching dataset☆22Updated 2 years ago
- Official repo for CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations☆32Updated last month
- ☆18Updated 2 months ago