hkproj / pytorch-loraLinks
LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
☆104Updated last year
Alternatives and similar repositories for pytorch-lora
Users that are interested in pytorch-lora are comparing it to the libraries listed below
Sorting:
- LLaMA 2 implemented from scratch in PyTorch☆329Updated last year
- Distributed training (multi-node) of a Transformer model☆68Updated last year
- LoRA and DoRA from Scratch Implementations☆203Updated last year
- ☆168Updated 5 months ago
- Notes about LLaMA 2 model☆61Updated last year
- Reference implementation of Mistral AI 7B v0.1 model.☆29Updated last year
- Notes on quantization in neural networks☆83Updated last year
- Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)☆168Updated last year
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆281Updated 2 years ago
- ☆35Updated last week
- I will build Transformer from scratch☆69Updated last year
- From scratch implementation of a vision language model in pure PyTorch☆220Updated last year
- making the official triton tutorials actually comprehensible☆34Updated 2 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆46Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆111Updated 8 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆91Updated last year
- Tutorial for how to build BERT from scratch☆93Updated last year
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆92Updated 5 months ago
- Notes and commented code for RLHF (PPO)☆94Updated last year
- ☆253Updated last week
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆54Updated last year
- Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch☆115Updated last month
- ML algorithms implementations that are good for learning the underlying principles☆22Updated 5 months ago
- A Simplified PyTorch Implementation of Vision Transformer (ViT)☆187Updated 11 months ago
- ML/DL Math and Method notes☆61Updated last year
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆67Updated last year
- Prune transformer layers☆69Updated last year
- Notes on Direct Preference Optimization☆19Updated last year
- Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).☆118Updated 7 months ago
- ☆132Updated last year