Alternatives and similar repositories for fineVideo:

Users that are interested in fineVideo are comparing it to the libraries listed below

• lucidrains / titok-pytorch
  Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
  ☆168Updated 9 months ago
• facebookresearch / EvalGIM
  🦾 EvalGIM (pronounced as "EvalGym") is an evaluation library for generative image models. It enables easy-to-use, reproducible automatic…
  ☆68Updated 3 months ago
• sayakpaul / simple-image-recaptioning
  Recaption large (Web)Datasets with vllm and save the artifacts.
  ☆48Updated 3 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆120Updated last month
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆195Updated this week
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆69Updated 2 months ago
• CERC-AAI / Robin
  ☆63Updated 5 months ago
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆50Updated 7 months ago
• huggingface / m4-logs
  M4 experiment logbook
  ☆57Updated last year
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆160Updated 3 months ago
• AskYoutubeAI / AskVideos-VideoCLIP
  ☆73Updated 5 months ago
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆75Updated 4 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆57Updated 3 weeks ago
• jiasenlu / LL3M
  LL3M: Large Language and Multi-Modal Model in Jax
  ☆70Updated 10 months ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆234Updated 2 months ago
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆68Updated 3 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆208Updated this week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆150Updated 3 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆199Updated 2 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆130Updated 4 months ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆124Updated last month
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆143Updated 9 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆98Updated last month
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆178Updated 6 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆160Updated 2 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆107Updated 3 weeks ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆156Updated 11 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated last month