Alternatives and similar repositories for assignment3-scaling

Users that are interested in assignment3-scaling are comparing it to the libraries listed below

• stanford-cs336 / spring2024-lectures
  ☆334Updated 7 months ago
• stanford-cs336 / assignment2-systems
  Student version of Assignment 2 for Stanford CS336 - Language Modeling From Scratch
  ☆50Updated last week
• stanford-cs336 / assignment1-basics
  Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch
  ☆499Updated last week
• huggingface / picotron_tutorial
  ☆206Updated 5 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆188Updated 2 months ago
• marin-community / marin
  ☆347Updated this week
• stanford-cs336 / assignment5-alignment
  ☆33Updated 2 weeks ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆164Updated 4 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆512Updated last month
• PrimeIntellect-ai / prime-rl
  Decentralized RL Training at Scale
  ☆400Updated last week
• jax-ml / scaling-book
  Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
  ☆445Updated last week
• LeonGuertler / UnstableBaselines
  ☆96Updated last week
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆383Updated 4 months ago
• tokenbender / avataRL
  rl from zero pretrain, can it be done? we'll see.
  ☆66Updated 2 weeks ago
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆272Updated 2 weeks ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆525Updated last year
• neubig / minllama-assignment
  ☆90Updated 10 months ago
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆64Updated 2 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆157Updated 3 months ago
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆204Updated last week
• project-numina / aimo-progress-prize
  ☆462Updated last year
• rwitten / HighPerfLLMs2024
  ☆518Updated last year
• cmu-l3 / anlp-spring2025-code
  Advanced NLP, Spring 2025 https://cmu-l3.github.io/anlp-spring2025/
  ☆61Updated 4 months ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆155Updated 2 weeks ago
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆505Updated last week
• Maharshi-Pandya / cudacodes
  Learnings and programs related to CUDA
  ☆414Updated last month
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆283Updated this week
• hkproj / triton-flash-attention
  ☆184Updated 7 months ago
• aryagxr / cuda
  coding CUDA everyday!
  ☆53Updated 3 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆245Updated 3 weeks ago