Alternatives and similar repositories for Coding-LLMs-from-scratch

Users that are interested in Coding-LLMs-from-scratch are comparing it to the libraries listed below

• cognitivecomputations / grokadamw
  ☆130Updated 9 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 3 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆67Updated 11 months ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆25Updated last year
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆36Updated last week
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 6 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 7 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• kabachuha / nanoGPKANT
  Testing KAN-based text generation GPT models
  ☆17Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆93Updated 3 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆76Updated last month
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆42Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 5 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 9 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆151Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 4 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆204Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆40Updated this week
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆39Updated 2 weeks ago
• cognitivecomputations / kraken
  ☆66Updated last year
• euclaise / supertrainer2000
  ☆49Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 5 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month