Alternatives and similar repositories for starter-kits

Users that are interested in starter-kits are comparing it to the libraries listed below

• wandb / aihackercup
  A competition to get you started on the NeurIPS AI Hackercup
  ☆28Updated 8 months ago
• Cohere-Labs-Community / AI-Alignment-Cohort
  ☆24Updated 7 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆184Updated last week
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 5 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆122Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆61Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆254Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆58Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆31Updated 3 months ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆136Updated last year
• hkproj / multi-latent-attention
  ☆35Updated last week
• yash-srivastava19 / arrakis
  Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.
  ☆29Updated last month
• srush / Tensor-Puzzles-Penzai
  ☆20Updated last year
• irregular-rhomboid / EAI-Math-Reading-Group
  Resources from the EleutherAI Math Reading Group
  ☆53Updated 3 months ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆127Updated 2 years ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆190Updated last year
• ahstat / episodic-memory-benchmark
  Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…
  ☆45Updated last month
• huggingface / picotron_tutorial
  ☆190Updated 3 months ago
• huggingface / competitions
  ☆123Updated 7 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆44Updated this week
• cloneofsimo / min-fsdp
  ☆78Updated 11 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 2 months ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆61Updated 3 weeks ago
• nano-R1 / resources
  Compiling useful links, papers, benchmarks, ideas, etc.
  ☆46Updated 2 months ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆139Updated 2 weeks ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆197Updated 8 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated last month