This repo contains the original implementation of VAuLT, the Vision-and-Augmented-Language Transformer. We provide instructions to download some multimodal social-media datasets, and scripts to experiment with. VAuLT is a stack of Transformers, a LM like BERT that preprocesses the text input of ViLT
☆18Sep 23, 2025Updated last year
Alternatives and similar repositories for VAuLT
Users that are interested in VAuLT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Oct 4, 2022Updated 4 years ago
- [COLING 2022] Learning from Adjective-Noun Pairs: A Knowledge-enhanced Framework for Target-Oriented Multimodal Sentiment Classification☆14Apr 19, 2023Updated 3 years ago
- ICME 2022: Few-shot Multi-modal Sentiment Analysis with Prompt-based Vision-aware Language Modeling☆16Nov 30, 2022Updated 3 years ago
- Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks☆41Jul 8, 2022Updated 4 years ago
- 多模态情感分析模型实现☆12Jan 31, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆86May 19, 2022Updated 4 years ago
- Sentiment Analysis based on images and text☆12Feb 14, 2016Updated 10 years ago
- base on deep learning, multi-modal fusion.☆15Sep 27, 2024Updated 2 years ago
- The code implementation of "M2DF: Multi-grained Multi-curriculum Denoising Framework for Multimodal Aspect-based Sentiment Analysis"☆17Dec 8, 2023Updated 2 years ago
- 疫情期间网民情绪识别比赛分享+top1~3解决方案☆51Sep 5, 2020Updated 6 years ago
- This is the code for the Paper "Guilherme L. Toledo, Ricardo M. Marcacini: Transfer Learning with Joint Fine-Tuning for Multimodal Sentim…☆17Jul 2, 2022Updated 4 years ago
- ☆11May 18, 2022Updated 4 years ago
- M-SENA: All-in-One Platform for Multimodal Sentiment Analysis☆105Mar 30, 2022Updated 4 years ago
- Environments with IC3Net paper☆15Jan 8, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code base for paper "Finding Structural Knowledge in Multimodal-BERT". Framework for probing and code for creating Scene Trees.☆10May 19, 2022Updated 4 years ago
- Used in M4C feature extraction script: https://github.com/facebookresearch/mmf/blob/project/m4c/projects/M4C/scripts/extract_ocr_frcn_fea…☆13Jan 30, 2020Updated 6 years ago
- ☆19Sep 5, 2024Updated 2 years ago
- ☆11Jul 24, 2025Updated last year
- An ambiguous subtitles dataset for visual scene-aware machine translation☆14Oct 17, 2022Updated 3 years ago
- ☆140Apr 5, 2023Updated 3 years ago
- ☆11Aug 19, 2026Updated last month
- ☆15Feb 9, 2023Updated 3 years ago
- 车载毫米波雷达项目☆10Jun 16, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Multi-modal Framework for Sentimental Analysis of Meme☆17Jan 29, 2021Updated 5 years ago
- ☆15Oct 9, 2022Updated 4 years ago
- Code for Paper "SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis", COLING2020☆13Oct 6, 2023Updated 3 years ago
- Bimodal and Unimodal Sentiment Analysis of Internet Memes (Image+Text)☆16Oct 3, 2021Updated 5 years ago
- Code for WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge☆17Dec 31, 2024Updated last year
- Group Gated Fusion on Attention-based Bidirectional Alignment for Multimodal Emotion Recognition☆15May 10, 2022Updated 4 years ago
- Unofficial Implementation to CDUL: CLIP-Driven Unsupervised Learning for Multi-Label Image Classification [ICCV'23]☆32May 30, 2024Updated 2 years ago
- ACM MM '22: Unified Multi-modal Pre-training for Few-shot Sentiment Analysis with Prompt-based Learning☆18Dec 20, 2022Updated 3 years ago
- An easy-to-use framework to turn any neural network definition in PyTorch into a Bayesian neural network.☆13Nov 24, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository is an implementation of "MASER: Multi-Agent Reinforcement Learning with Subgoals Generated from Experience Replay Buffer"…☆23Jul 6, 2023Updated 3 years ago
- This repository contains code for paper VICTR: Visual Information Captured Text Representation for Text-to-Image Multimodal Tasks☆14Nov 20, 2021Updated 4 years ago
- The Emergence of Individuality☆13Oct 16, 2021Updated 4 years ago
- [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning☆40Jul 29, 2023Updated 3 years ago
- Official code of our work, Syntax-augmented Multilingual BERT for Cross-lingual Transfer [ACL 2021].☆16Dec 2, 2021Updated 4 years ago
- Dataset and codes for our IJCAI 2019 paper "Adapting BERT for Target-Oriented Multimodal Sentiment Classification"☆86Mar 31, 2020Updated 6 years ago
- [ICASSP'23] This repo contains code for the Demux & MEmo emotion recognition models (https://arxiv.org/abs/2210.15842), as well as code t…☆23Jan 18, 2024Updated 2 years ago