hkproj / pytorch-loraLinks
LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
☆116Updated 2 years ago
Alternatives and similar repositories for pytorch-lora
Users that are interested in pytorch-lora are comparing it to the libraries listed below
Sorting:
- LLaMA 2 implemented from scratch in PyTorch☆350Updated last year
- Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)☆308Updated 2 years ago
- LoRA and DoRA from Scratch Implementations☆211Updated last year
- From scratch implementation of a vision language model in pure PyTorch☆239Updated last year
- Tutorial for how to build BERT from scratch☆99Updated last year
- ☆44Updated 3 months ago
- A Simplified PyTorch Implementation of Vision Transformer (ViT)☆205Updated last year
- Distributed training (multi-node) of a Transformer model☆83Updated last year
- Notes on quantization in neural networks☆98Updated last year
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 11 months ago
- Implementation of the paper "Denoising Diffusion Probabilistic Models" in PyTorch☆64Updated 2 years ago
- ☆199Updated 8 months ago
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- GPU Kernels☆193Updated 4 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆48Updated last year
- Notes about LLaMA 2 model☆68Updated 2 years ago
- Notes and commented code for RLHF (PPO)☆106Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆185Updated 6 months ago
- Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.☆259Updated last year
- Code Transformer neural network components piece by piece☆362Updated 2 years ago
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆178Updated last month
- a simplified version of Meta's Llama 3 model to be used for learning☆42Updated last year
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems☆127Updated 7 months ago
- I will build Transformer from scratch☆81Updated last month
- Notebooks for fine tuning pali gemma☆117Updated 5 months ago
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆71Updated last year
- Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)☆170Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆183Updated last year
- minimal GRPO implementation from scratch☆96Updated 6 months ago
- Rebuild the Stable Diffusion Model in a single python script. Tutorial for Harvard ML from Scratch Series☆216Updated 7 months ago