Atrewin / SignXmDA
This is the official code repository for the paper 'Cross-modality Data Augmentation for End-to-End Sign Language Translation'. Accepted at Findings EMNLP 2023
☆13Updated 11 months ago
Related projects: ⓘ
- Implementation of our paper "Scaling Back-Translation with Domain Text Generation for Sign Language Gloss Translation". Accepted in EACL …☆11Updated last year
- SLTUNET: A Simple Unified Model for Sign Language Translation (ICLR 2023)☆27Updated last year
- Code for Paper "Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data Augmentation"☆13Updated last year
- ☆22Updated 3 years ago
- ☆42Updated 6 months ago
- ☆26Updated 10 months ago
- ☆13Updated 5 months ago
- Code for ACL 2022 main conference paper "Neural Machine Translation with Phrase-Level Universal Visual Representations".☆21Updated 10 months ago
- Code for EMNLP 2022 main conference paper "Low-resource Neural Machine Translation with Cross-modal Alignment".☆14Updated last year
- This code repository is for the accepted ACL2022 paper "On Vision Features in Multimodal Machine Translation". We provide the details and…☆43Updated 2 years ago
- Public repo for the paper: "Modeling Intensification for Sign Language Generation: A Computational Approach" by Mert Inan*, Yang Zhong*, …☆13Updated 2 years ago
- Code and Data for the ACL22 main conference paper "MSCTD: A Multimodal Sentiment Chat Translation Dataset"☆40Updated last year
- Frozen Pretrained Transformers for Neural Sign Language Translation☆15Updated 2 years ago
- Code of "Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model"☆19Updated 2 months ago
- Sign Language Translation for Instructional Videos - CVPR WiCV 2023☆33Updated last year
- Code for ACL 2023 paper: Exploring Better Text Image Translation with Multimodal Codebook☆20Updated last year
- Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.☆50Updated last year
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆54Updated 2 years ago
- This repository contains code and metadata of How2 dataset☆160Updated last month
- Implementation of CV-SLT (Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignment).☆10Updated 7 months ago
- Code for the paper "Controllable Video Captioning with an Exemplar Sentence"☆12Updated 3 years ago
- ☆15Updated 3 years ago
- Code for the ICLR'22 paper "Improving Non-Autoregressive Translation Models Without Distillation"☆17Updated 2 years ago
- Code, Models and Datasets for OpenViDial Dataset☆131Updated 2 years ago
- [ACM MM 2022]: Multi-Modal Experience Inspired AI Creation☆18Updated 3 months ago
- Code for ACL 2022 main conference paper "STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation".☆35Updated 10 months ago
- Cross-lingual Visual Pre-training for Multimodal Machine Translation☆18Updated 2 years ago
- ☆18Updated 3 months ago
- Implementation of our ACL2023 paper: Unifying Cross-Lingual and Cross-Modal Modeling Towards Weakly Supervised Multilingual Vision-Langua…☆14Updated last year
- The Social-IQ 2.0 Challenge Release for the Artificial Social Intelligence Workshop at ICCV '23☆19Updated 11 months ago