Alternatives and similar repositories for FastCLIP

Users that are interested in FastCLIP are comparing it to the libraries listed below

• wangf3014 / Patch_Scaling
  Official implementation of Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More
  ☆23Updated 3 months ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated last year
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• XMUDeepLIT / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆28Updated 7 months ago
• HelmholtzAI-FZJ / flex_gen
  ☆17Updated 4 months ago
• adobe-research / ImageFolder
  ☆17Updated 5 months ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆35Updated 11 months ago
• archiki / RepARe
  ☆19Updated last year
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆40Updated 6 months ago
• showlab / datacentric.vlp
  Compress conventional Vision-Language Pre-training data
  ☆51Updated last year
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆14Updated 6 months ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 8 months ago
• jeykigung / HiCLIP
  ☆29Updated 2 years ago
• iancovert / locality-alignment
  ☆50Updated 4 months ago
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆18Updated 7 months ago
• techmonsterwang / iLLaMA
  Adapting LLaMA Decoder to Vision Transformer
  ☆28Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• hammoudhasan / DiffCLIP
  Official Implementation of DiffCLIP: Differential Attention Meets CLIP
  ☆30Updated 2 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆52Updated 7 months ago
• locuslab / llava-token-compression
  ☆42Updated 6 months ago
• ytaek-oh / fsc-clip
  [EMNLP 2024] Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality
  ☆16Updated 8 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆45Updated 4 months ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated 10 months ago
• facebookresearch / SIEVE
  SIEVE: Multimodal Dataset Pruning using Image-Captioning Models (CVPR 2024)
  ☆16Updated last year
• ByteDance-Seed / SAIL
  Implementation for "The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer"
  ☆37Updated 2 weeks ago
• yuhui-zh15 / C3
  Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)
  ☆31Updated 7 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆56Updated 5 months ago
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆58Updated 2 months ago
• ethanlshen / HierNet
  Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…
  ☆21Updated last year
• zehanwang01 / OmniBind
  ☆31Updated last month