Research Code for Multimodal-Cognition Team in Ant Group
β179Oct 14, 2025Updated 9 months ago
Alternatives and similar repositories for Ant-Multi-Modal-Framework
Users that are interested in Ant-Multi-Modal-Framework are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ECCV 2024π₯] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"β155Sep 10, 2024Updated last year
- A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenariosβ13Jan 24, 2024Updated 2 years ago
- This repository contains the dataset, codebase, and benchmarks for our paper: <CNVid-3.5M: Build, Filter, and Pre-train the Large-scale Pβ¦β26Nov 28, 2023Updated 2 years ago
- M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoningβ47Jul 17, 2025Updated last year
- [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.β49Oct 14, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understandingβ49Jan 14, 2025Updated last year
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.β179Jan 30, 2025Updated last year
- β17Oct 15, 2023Updated 2 years ago
- [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition informationβ16Oct 27, 2024Updated last year
- β22Aug 8, 2024Updated 2 years ago
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"β901Aug 13, 2024Updated last year
- β13Jun 11, 2026Updated last month
- LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learningβ78May 23, 2025Updated last year
- γCVPR'2023 Highlight & TPAMIγCap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?β255Nov 29, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI β’ AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [AAAI 2024] GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrievalβ21May 10, 2024Updated 2 years ago
- Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.β5,987Mar 31, 2026Updated 4 months ago
- [ICCV 2023] ALIP: Adaptive Language-Image Pre-training with Synthetic Captionβ106Sep 18, 2023Updated 2 years ago
- β25Jun 22, 2026Updated last month
- β30Aug 14, 2023Updated 2 years ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"β1,030Apr 12, 2024Updated 2 years ago
- TVBench: Redesigning Video-Language Evaluationβ15Jun 9, 2025Updated last year
- [CVPR2023] All in One: Exploring Unified Video-Language Pre-trainingβ281Mar 25, 2023Updated 3 years ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool woβ¦β27Sep 25, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Ranking-Consistent Language-Image Pretrainingβ15Oct 24, 2025Updated 9 months ago
- Official implementation of CVPR 2024 paper "vid-TLDR: Training Free Token merging for Light-weight Video Transformer".β55Oct 21, 2025Updated 9 months ago
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. ζ₯θΏGPT-4o葨η°ηεΌζΊε€ζ¨‘ζε―Ήθ―樑εβ10,121Sep 22, 2025Updated 10 months ago
- Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learningβ21Feb 19, 2025Updated last year
- Pytorch Code for "Unified Coarse-to-Fine Alignment for Video-Text Retrieval" (ICCV 2023)β66Jun 7, 2024Updated 2 years ago
- β26Mar 29, 2025Updated last year
- Papers about the ultra high resolution tasks.β13Jul 12, 2024Updated 2 years ago
- [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captionsβ138May 8, 2025Updated last year
- This repo is used for downloading the videos for SVD dataset.β18Aug 16, 2020Updated 5 years ago
- End-to-end encrypted cloud storage - Proton Drive β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- official code for "Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval"β42Jul 4, 2025Updated last year
- β60Aug 10, 2023Updated 3 years ago
- Open-Vocabulary High-Resolution Remote Sensing Image Semantic Segmentationβ31Sep 19, 2025Updated 10 months ago
- EVA Series: Visual Representation Fantasies from BAAIβ2,688Aug 1, 2024Updated 2 years ago
- Chinese-native image generation while compatible with SD eco-system, 1st-gen, AAAI2025β13Jun 25, 2024Updated 2 years ago
- mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)β227Jul 21, 2023Updated 3 years ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionsβ2,924May 26, 2025Updated last year