Alternatives and similar repositories for VisionGPT2

Users that are interested in VisionGPT2 are comparing it to the libraries listed below

• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆252Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated last month
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 7 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆232Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆61Updated last year
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 4 months ago
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆188Updated last year
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆117Updated 8 months ago
• QuixiAI / grokadamw
  ☆136Updated last year
• joey00072 / Multi-Head-Latent-Attention-MLA-
  working implimention of deepseek MLA
  ☆45Updated 11 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆77Updated 5 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆215Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆74Updated 2 years ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆15Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated last year
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆103Updated 11 months ago
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆167Updated last year
• VatsaDev / nanoChatGPT
  nanogpt turned into a chat model
  ☆79Updated 2 years ago
• CERC-AAI / Robin
  ☆63Updated last year
• Delve-ERAV1 / Phi-2-Vision-Language
  Pretraining and finetuning for visual instruction following with Mixture of Experts
  ☆16Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆124Updated 10 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆74Updated last year
• catid / dora
  Implementation of DoRA
  ☆307Updated last year
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆84Updated last year
• broskicodes / slms
  Experimenting with small language models
  ☆75Updated last year
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated last year