Alternatives and similar repositories for Simple_Llama3_from_scratch

Users that are interested in Simple_Llama3_from_scratch are comparing it to the libraries listed below

• hkproj / multi-latent-attention
  ☆45Updated 7 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 8 months ago
• kmohan321 / Research_Papers
  ☆46Updated 8 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆54Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆74Updated last year
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆121Updated last year
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆254Updated last year
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆117Updated 8 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆49Updated last year
• kabir2505 / tiny-mixtral
  ☆45Updated 7 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆337Updated 8 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆61Updated last year
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆163Updated 4 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆47Updated 10 months ago
• QuixiAI / grokadamw
  ☆136Updated last year
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated last year
• kyegomez / swarms-pytorch
  Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
  ☆134Updated 2 months ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆48Updated last year
• shreydan / VisionGPT2
  Combining ViT and GPT-2 for image captioning. Trained on MS-COCO. The model was implemented mostly from scratch.
  ☆47Updated 2 years ago
• okarthikb / state-space-models
  ☆28Updated last year
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆202Updated last year
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆28Updated 3 weeks ago
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆75Updated 7 months ago
• ashishpatel26 / ai-tutor-rag-system
  This is a repository for the course "From Beginner to LLM Developer" by Towards AI.
  ☆12Updated 11 months ago
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆195Updated last year