Alternatives and similar repositories for Coding-LLMs-from-scratch:

Users that are interested in Coding-LLMs-from-scratch are comparing it to the libraries listed below

• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆60Updated this week
• mzbac / mlx-lora
  ☆38Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆25Updated 10 months ago
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆65Updated 10 months ago
• sanchit-gandhi / notebooks
  A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).
  ☆45Updated 8 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated 2 months ago
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆22Updated 3 weeks ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆89Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 2 months ago
• evintunador / minGemma
  a simplified version of Google's Gemma model to be used for learning
  ☆24Updated last year
• githubpradeep / notebooks
  ☆52Updated 2 months ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆35Updated this week
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆67Updated 6 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 3 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆146Updated last year
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 7 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated 7 months ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆39Updated 2 months ago
• bipul1010 / agents_tutorial
  ☆19Updated 8 months ago
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 8 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆202Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated 11 months ago
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆17Updated 10 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆96Updated last month