Alternatives and similar repositories for Llama-3-PyTorch

Users that are interested in Llama-3-PyTorch are comparing it to the libraries listed below

• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆190Updated last year
• Blaizzy / Coding-LLMs-from-scratch
  ☆36Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• hkproj / multi-latent-attention
  ☆45Updated 6 months ago
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆73Updated 7 months ago
• kabir2505 / tiny-mixtral
  ☆45Updated 6 months ago
• VizuaraAI / nano-gpt-oss
  Learn the building blocks of how to build gpt-oss from scratch
  ☆105Updated 2 months ago
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆36Updated 6 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆113Updated 6 months ago
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆191Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• huggingface / trl-jobs
  Train LLM on Hugging Face infra
  ☆67Updated 2 weeks ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 7 months ago
• 1y33 / 100Days
  GPU Kernels
  ☆209Updated 7 months ago
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆77Updated 7 months ago
• ariG23498 / gemma3-object-detection
  Fine tune Gemma 3 on an object detection task
  ☆89Updated 4 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆324Updated 2 years ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆215Updated 8 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆196Updated 5 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆250Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆122Updated 10 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆87Updated last year
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆57Updated last year
• QuixiAI / grokadamw
  ☆136Updated last year
• kmohan321 / Research_Papers
  ☆46Updated 7 months ago
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆66Updated last week
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆186Updated this week
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆162Updated 3 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆99Updated 8 months ago