Alternatives and similar repositories for VisionGPT2

Users that are interested in VisionGPT2 are comparing it to the libraries listed below

• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆227Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆69Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆66Updated 10 months ago
• cognitivecomputations / grokadamw
  ☆134Updated 10 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• VatsaDev / nanoChatGPT
  nanogpt turned into a chat model
  ☆69Updated last year
• sshh12 / multi_token
  Embed arbitrary modalities (images, audio, documents, etc) into large language models.
  ☆184Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆55Updated last year
• neulab / Pangea
  This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"
  ☆108Updated 2 weeks ago
• vmarinowski / infini-attention
  An unofficial pytorch implementation of 'Efficient Infinite Context Transformers with Infini-attention'
  ☆52Updated 10 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆81Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆232Updated 8 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆165Updated 5 months ago
• google-deepmind / calm
  ☆48Updated last week
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 4 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆92Updated 4 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆206Updated last year
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆100Updated 6 months ago
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆69Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆114Updated 5 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆198Updated 11 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆101Updated 4 months ago
• hkproj / multi-latent-attention
  ☆40Updated last month
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 8 months ago
• writer / writing-in-the-margins
  ☆118Updated 10 months ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆158Updated 3 months ago