Alternatives and similar repositories for Coding-LLMs-from-scratch

Users that are interested in Coding-LLMs-from-scratch are comparing it to the libraries listed below

• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆24Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• cognitivecomputations / grokadamw
  ☆130Updated 9 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆98Updated 2 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆67Updated 11 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 8 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 6 months ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆54Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆53Updated 3 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 11 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆40Updated 2 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆150Updated last year
• geronimi73 / 3090_shorts
  minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆38Updated last month
• geronimi73 / phi2-finetune
  ☆87Updated last year
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• BrunoGeorgevich / llama3.cp
  Adapted version of llama3.np (NumPy) to a CuPy implementation for the Llama 3 model.
  ☆35Updated last year
• githubpradeep / notebooks
  ☆52Updated 3 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 4 months ago
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆87Updated 10 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆238Updated 11 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆105Updated last month
• swj0419 / detect-pretrain-code-contamination
  ☆75Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 3 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 11 months ago