evintunador / minLlama3Links
a simplified version of Meta's Llama 3 model to be used for learning
☆42Updated last year
Alternatives and similar repositories for minLlama3
Users that are interested in minLlama3 are comparing it to the libraries listed below
Sorting:
- LLaMA 2 implemented from scratch in PyTorch☆347Updated last year
- LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch☆113Updated 2 years ago
- From scratch implementation of a vision language model in pure PyTorch☆235Updated last year
- ☆43Updated 3 months ago
- This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…☆70Updated last year
- LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.☆178Updated last year
- LoRA and DoRA from Scratch Implementations☆210Updated last year
- Distributed training (multi-node) of a Transformer model☆79Updated last year
- First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…☆178Updated last month
- Reference implementation of Mistral AI 7B v0.1 model.☆28Updated last year
- Tutorial for how to build BERT from scratch☆98Updated last year
- Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.☆182Updated last year
- Llama from scratch, or How to implement a paper without crying☆578Updated last year
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆158Updated 2 weeks ago
- An extension of the nanoGPT repository for training small MOE models.☆181Updated 5 months ago
- nanogpt turned into a chat model☆72Updated 2 years ago
- Simple Adaptation of BitNet☆32Updated last year
- minimal GRPO implementation from scratch☆96Updated 5 months ago
- A compact LLM pretrained in 9 days by using high quality data☆322Updated 4 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆117Updated 3 months ago
- LLM Workshop by Sourab Mangrulkar☆392Updated last year
- customizable template GPT code designed for easy novel architecture experimentation☆26Updated 5 months ago
- Implementation of DoRA☆301Updated last year
- Experimenting with small language models☆70Updated last year
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆125Updated last year
- Notes and commented code for RLHF (PPO)☆104Updated last year
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆291Updated last year
- Official repository for ORPO☆463Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.☆121Updated last year
- Implements Low-Rank Adaptation(LoRA) Finetuning from scratch☆79Updated 2 years ago