Alternatives and similar repositories for Coding-LLMs-from-scratch

Users that are interested in Coding-LLMs-from-scratch are comparing it to the libraries listed below

• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆26Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 11 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆161Updated 2 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated 3 weeks ago
• QuixiAI / grokadamw
  ☆136Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆178Updated last year
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆112Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 9 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆83Updated last month
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• geronimi73 / qlora-minimal
  ☆87Updated last year
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆96Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆73Updated 5 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆220Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated last year
• NousResearch / finetuning-subnet
  ☆120Updated last year
• rmihaylov / mpttune
  Tune MPTs
  ☆84Updated 2 years ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆201Updated last year
• TrelisResearch / one-click-llms
  One click templates for inferencing Language Models
  ☆212Updated 2 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆42Updated 2 years ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆32Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year