Alternatives and similar repositories for pytorch-lora:

Users that are interested in pytorch-lora are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆198Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆200Updated 10 months ago
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• hkproj / triton-flash-attention
  ☆131Updated 2 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆303Updated last year
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆256Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆57Updated 11 months ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆166Updated 9 months ago
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆161Updated last year
• shreydan / VisionGPT2
  Combining ViT and GPT-2 for image captioning. Trained on MS-COCO. The model was implemented mostly from scratch.
  ☆41Updated last year
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆75Updated last year
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆90Updated 9 months ago
• hkproj / pytorch-transformer
  Attention is all you need implementation
  ☆826Updated 9 months ago
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆105Updated this week
• explainingai-code / DiT-PyTorch
  This repo implements Diffusion Transformers(DiT) in PyTorch and provides training and inference code on CelebHQ dataset
  ☆26Updated 2 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 9 months ago
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆53Updated last year
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆335Updated last year
• ChanCheeKean / DataScience
  ☆79Updated 11 months ago
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆60Updated 9 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆68Updated 9 months ago
• hkproj / pytorch-paligemma
  Coding a Multimodal (Vision) Language Model from scratch in PyTorch with full explanation: https://www.youtube.com/watch?v=vAmKB7iPkWw
  ☆413Updated 3 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆87Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆114Updated 9 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆162Updated 3 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆74Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆94Updated last month