Alternatives and similar repositories for Llama-3-PyTorch

Users that are interested in Llama-3-PyTorch are comparing it to the libraries listed below

• kabir2505 / tiny-mixtral
  ☆45Updated 5 months ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆50Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆48Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• hkproj / multi-latent-attention
  ☆45Updated 5 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆86Updated last year
• sayakpaul / hf-codegen
  A repository of Python scripts to scrape code contents of the public repositories of `huggingface`.
  ☆52Updated last year
• hkproj / triton-flash-attention
  ☆210Updated 10 months ago
• PacktPublishing / Accelerate-Model-Training-with-PyTorch-2.X
  Accelerate Model Training with PyTorch 2.X, published by Packt
  ☆47Updated last month
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆75Updated 6 months ago
• broskicodes / slms
  Experimenting with small language models
  ☆74Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆358Updated 2 years ago
• 1y33 / 100Days
  GPU Kernels
  ☆203Updated 6 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆194Updated 5 months ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆188Updated last year
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆73Updated 6 months ago
• VizuaraAI / nano-gpt-oss
  Learn the building blocks of how to build gpt-oss from scratch
  ☆91Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 7 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 6 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆44Updated 8 months ago
• geronimi73 / phi2-finetune
  ☆88Updated last year
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆160Updated last year
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆57Updated 2 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆161Updated 2 months ago
• Blaizzy / Coding-LLMs-from-scratch
  ☆34Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆59Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆163Updated last week
• ALucek / GRPO-Training
  An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning
  ☆37Updated 5 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆319Updated 2 years ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year