[TMLR 2022] High-Modality Multimodal Transformer
☆117Nov 2, 2024Updated last year
Alternatives and similar repositories for HighMMT
Users that are interested in HighMMT are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning☆613Jan 27, 2024Updated 2 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆116Nov 30, 2022Updated 3 years ago
- ☆21Mar 15, 2023Updated 2 years ago
- ☆14May 31, 2022Updated 3 years ago
- Official implementation of the paper The Hidden Language of Diffusion Models☆77Jan 24, 2024Updated 2 years ago
- Official code for the paper: "Metadata Archaeology"☆19May 10, 2023Updated 2 years ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆99Aug 22, 2024Updated last year
- AgentHive provides the primitives and helpers for a seamless usage of robohive within TorchRL.☆35Jan 12, 2024Updated 2 years ago
- Holistic evaluation of multimodal foundation models☆49Aug 11, 2024Updated last year
- [Preprint 2022] “Can We Solve 3D Vision Tasks Starting from A 2D Vision Transformer?” by Yi Wang, Zhiwen Fan, Tianlong Chen, Hehe Fan, Zh…☆63Jan 18, 2023Updated 3 years ago
- The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)☆310Sep 22, 2025Updated 5 months ago
- Repository for the PopulAtion Parameter Averaging (PAPA) paper☆31Apr 11, 2024Updated last year
- ☆23Feb 4, 2023Updated 3 years ago
- ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio☆52Jul 11, 2025Updated 7 months ago
- Improved diffusion generative models with subspaces☆135Jun 1, 2022Updated 3 years ago
- Implementation for NATv2.☆23Feb 20, 2021Updated 5 years ago
- Code to accompany the paper Sparse Linear Networks with a Fixed Butterfly Structure: Theory and Practice☆10Aug 10, 2021Updated 4 years ago
- audio, NLP, ML with huggingface, nvidia/nemo, speechbrain☆11Sep 4, 2023Updated 2 years ago
- ☆27Feb 9, 2023Updated 3 years ago
- Official PyTorch implementation of "Playable Environments: Video Manipulation in Space and Time", CVPR 2022☆72Oct 16, 2022Updated 3 years ago
- This is an implementation of the paper "Are We Done with Object-Centric Learning?"☆12Sep 11, 2025Updated 5 months ago
- Interactively evolve various types of art (pictures, animations, shapes, and sounds) using Compositional Pattern Producing Networks☆21May 9, 2018Updated 7 years ago
- GPT as Knowledger Worker (or if you really want, GPT Sorta' Takes the CPA Exam)☆13Jan 24, 2023Updated 3 years ago
- Official code for DAM: Dynamic Adapter Merging for Continual Video QA Learning☆14Apr 25, 2024Updated last year
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)☆12Jun 1, 2023Updated 2 years ago
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 2 years ago
- Counterfactual Evaluation and Learning for Interactive Systems: Foundations, Implementations, and Recent Advances☆12Aug 14, 2022Updated 3 years ago
- Implementation for "DeltaPhi: Learning Physical Trajectory Residual for PDE Solving"☆13Jun 17, 2024Updated last year
- PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"☆241Jan 20, 2023Updated 3 years ago
- [ICML 2023] Provable Dynamic Fusion for Low-Quality Multimodal Data☆118Jun 28, 2025Updated 8 months ago
- Code and datasets for "Text encoders are performance bottlenecks in contrastive vision-language models". Coming soon!☆11May 24, 2023Updated 2 years ago
- Official Implementation of "Natural Posterior Network: Deep Bayesian Predictive Uncertainty for Exponential Family Distributions" (ICLR, …☆87Apr 5, 2023Updated 2 years ago
- ☆12Dec 11, 2020Updated 5 years ago
- Pretraining summarization models using a corpus of nonsense☆13Sep 28, 2021Updated 4 years ago
- ☆19Jun 4, 2025Updated 8 months ago
- ☆14May 25, 2022Updated 3 years ago
- [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"☆49Dec 7, 2022Updated 3 years ago
- ☆33Mar 1, 2023Updated 3 years ago
- [AAAI 2023 (Oral)] CrissCross: Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity☆25Jul 11, 2023Updated 2 years ago