mit-han-lab / streaming-vlmLinks
StreamingVLM: Real-Time Understanding for Infinite Video Streams
☆447Updated this week
Alternatives and similar repositories for streaming-vlm
Users that are interested in streaming-vlm are comparing it to the libraries listed below
Sorting:
- ☆88Updated last year
- ☆78Updated 5 months ago
- This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"☆113Updated 3 months ago
- ☆55Updated 10 months ago
- [NeurIPS 2025] Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆63Updated 3 weeks ago
- The official repository of "R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Integration"☆113Updated last month
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 7 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆37Updated last year
- Official PyTorch implementation of TokenSet.☆125Updated 6 months ago
- [ICCV 2025] OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning☆398Updated last month
- Video-LlaVA fine-tune for CinePile evaluation☆51Updated last year
- ☆79Updated last year
- An official implementation of "CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning"☆83Updated 2 weeks ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆211Updated 9 months ago
- Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.☆113Updated last month
- (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…☆82Updated 2 months ago
- ☆104Updated 6 months ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]☆90Updated 2 months ago
- [ACL2025 Oral & Award] Evaluate Image/Video Generation like Humans - Fast, Explainable, Flexible☆104Updated 2 months ago
- ☆19Updated 7 months ago
- Documentation, notes, links, etc for streams.☆82Updated last year
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆116Updated 2 months ago
- Projects based on SigLIP (Zhai et. al, 2023) and Hugging Face transformers integration 🤗☆277Updated 7 months ago
- [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos☆45Updated 4 months ago
- Use Florence 2 to auto-label data for use in training fine-tuned object detection models.☆67Updated last year
- ☆35Updated 8 months ago
- Multimodal Open Source Framework for Conversational Agent Research and Development.☆21Updated 8 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆82Updated 11 months ago
- ☆159Updated 2 months ago
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆182Updated last year