Alternatives and similar repositories for starter-kits

Users that are interested in starter-kits are comparing it to the libraries listed below

• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆116Updated last year
• wandb / aihackercup
  A competition to get you started on the NeurIPS AI Hackercup
  ☆29Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆198Updated 8 months ago
• Cohere-Labs-Community / AI-Alignment-Cohort
  ☆29Updated last year
• divyamakkar0 / JAXformer
  A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.
  ☆115Updated last month
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆66Updated 2 years ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆120Updated 8 months ago
• muellerzr / nbdistributed
  Seemless interface of using PyTOrch distributed with Jupyter notebooks
  ☆57Updated 4 months ago
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆15Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆260Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆86Updated 2 years ago
• huggingface / competitions
  ☆125Updated last year
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated 2 weeks ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆60Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated last week
• srush / Tensor-Puzzles-Penzai
  ☆22Updated last year
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆135Updated 2 years ago
• kevinwu23 / StanfordFineTuneBench
  ☆31Updated last year
• Noumena-Network / nmoe
  MoE training for Me and You and maybe other people
  ☆335Updated last month
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆175Updated 7 months ago
• cloneofsimo / min-fsdp
  ☆92Updated last year
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆298Updated last year
• google-deepmind / onetwo
  ☆259Updated 2 months ago
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆49Updated last year
• sangmichaelxie / cs324_p2
  Project 2 (Building Large Language Models) for Stanford CS324: Understanding and Developing Large Language Models (Winter 2022)
  ☆105Updated 2 years ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆117Updated 9 months ago