neulab / Pangea

Related projects ⓘ

Alternatives and complementary repositories for Pangea

• mbzuai-oryx / PALO
  (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, B…
  ☆81Updated 2 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆53Updated 4 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆83Updated last month
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆105Updated last month
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆37Updated 3 weeks ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆168Updated 3 months ago
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆47Updated last month
• vis-nlp / ChartGemma
  ☆55Updated 3 months ago
• XiaoduoAILab / XmodelVLM
  ☆58Updated 4 months ago
• du-nlp-lab / MLR-Copilot
  ☆57Updated last month
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆160Updated 6 months ago
• tencent-ailab / CogKernel
  ☆44Updated last month
• deepseek-ai / ESFT
  Expert Specialized Fine-Tuning
  ☆143Updated last month
• hyintell / RetrievalQA
  Source code of the paper: RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering [F…
  ☆57Updated 5 months ago
• nttmdlab-nlp / InstructDoc
  InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)
  ☆137Updated 5 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆144Updated last week
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆126Updated this week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆178Updated last month
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆161Updated 2 months ago
• andimarafioti / florence2-finetuning
  Quick exploration into fine tuning florence 2
  ☆267Updated last month
• CogNLP / CogAGENT
  ☆35Updated last year
• gregor-ge / mBLIP
  ☆86Updated 10 months ago
• dnth / x.infer
  Framework agnostic computer vision inference. Run 1000+ models by changing only one line of code. Supports models from transformers, timm…
  ☆119Updated this week
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆168Updated last week
• Victorwz / LLaVA-Llama-3
  Reproduction of LLaVA-v1.5 based on Llama-3-8b LLM backbone.
  ☆58Updated 2 weeks ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆77Updated 5 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆60Updated 3 months ago
• tigerchen52 / awesome_role_of_small_models
  a curated list of the role of small models in the LLM era
  ☆76Updated last month
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆151Updated 7 months ago
• zhangfaen / finetune-Qwen2-VL
  ☆181Updated last week