Alternatives and similar repositories for Coding-LLMs-from-scratch:

Users that are interested in Coding-LLMs-from-scratch are comparing it to the libraries listed below

• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆65Updated 9 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆29Updated 2 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆54Updated last year
• cognitivecomputations / grokadamw
  ☆126Updated 6 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 10 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆103Updated 8 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 9 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆52Updated this week
• cognitivecomputations / kraken
  ☆65Updated 9 months ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆143Updated 11 months ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆26Updated last year
• mlabonne / chessllm
  ☆34Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆25Updated 8 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 3 months ago
• official-elinas / zeus-llm-trainer
  Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models
  ☆69Updated last year
• zjohn77 / lightning-mlflow-hf
  Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
  ☆59Updated last year
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆41Updated last year
• Vaibhavs10 / gpu-poor-llm-notebooks
  ☆75Updated 5 months ago
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆14Updated 9 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 11 months ago
• sanchit-gandhi / notebooks
  A collection of notebooks for the Hugging Face blog series (https://huggingface.co/blog).
  ☆43Updated 7 months ago