njustkmg / OMML
Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.
☆564Updated last year
Related projects ⓘ
Alternatives and complementary repositories for OMML
- Open source deep learning based fine-grained image recognition toolbox built on PyTorch🔥☆574Updated 5 months ago
- A scientific and useful toolbox, which contains practical and effective long-tail related tricks with extensive experimental results☆578Updated 2 years ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆269Updated 6 months ago
- [NeurIPS 2022] Official Code for REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering☆134Updated last month
- Real-time and accurate open-vocabulary end-to-end object detection☆1,527Updated 2 months ago
- DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Models☆132Updated 2 months ago
- ☆166Updated last year
- Learning Semantic Relationship among Instances for Image-Text Matching, CVPR, 2023☆88Updated last year
- Cross-modal few-shot adaptation with CLIP☆315Updated 7 months ago
- [ECCV 2022] Official implementation of the paper: Audio-Visual Segmentation☆444Updated 2 months ago
- [CVPR'23] Universal Instance Perception as Object Discovery and Retrieval☆1,502Updated last year
- The official source code for the paper Consensus-Aware Visual-Semantic Embedding for Image-Text Matching (ECCV 2020)☆171Updated 2 years ago
- MLGB is a library that includes many models of CTR Prediction & Recommender System by TensorFlow & PyTorch. MLGB是一个包含50+点击率预估和推荐系统深度模型的、通…☆520Updated 2 months ago
- [NeurIPS 2024] AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation☆75Updated last month
- [ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for …☆1,455Updated 9 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆558Updated 5 months ago
- GMoE could be the next backbone model for many kinds of generalization task.☆296Updated last year
- Completed this competition in collaboration with Jiang Yan(https://github.com/jy1993) and Guan Shuicheng(https://github.com/guanshuicheng…☆504Updated last week
- The code for COLING2022 paper: 《TSAM: A Two-Stream Attention Model for Causal Emotion Entailment》☆37Updated last year
- 【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?☆238Updated 2 months ago
- 【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models☆1,824Updated last week
- A Semantic Controllable Self-Supervised Learning Framework to learn general human representations from massive unlabeled human images, wh…☆1,917Updated last year
- MLCD & UNICOM : Large-Scale Visual Representation Model☆337Updated this week
- Colar: Effective and Efficient Online Action Detection by Consulting Exemplars, CVPR 2022.☆265Updated 2 years ago
- A curated (most recent) list of resources for Learning with Noisy Labels☆683Updated 3 weeks ago
- Generative Neural Methods Based On Model Iteration☆516Updated last year
- [MM'24 Oral] Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval☆139Updated 2 months ago
- Tiny3D is a next generation of 3D AI service production system.☆601Updated last year
- [EMNLP'2024] "OpenGraph: Towards Open Graph Foundation Models"☆267Updated last month
- The official implementation of BackTAL, TPAMI 2021.☆218Updated 2 years ago