Alternatives and similar repositories for assignment3-scaling

Users that are interested in assignment3-scaling are comparing it to the libraries listed below

• stanford-cs336 / assignment5-alignment
  ☆28Updated last month
• huggingface / picotron_tutorial
  ☆198Updated 5 months ago
• stanford-cs336 / assignment1-basics
  Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch
  ☆348Updated 3 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆188Updated last month
• cloneofsimo / min-fsdp
  ☆79Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆147Updated 2 weeks ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆160Updated 4 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆77Updated last year
• nano-R1 / resources
  Compiling useful links, papers, benchmarks, ideas, etc.
  ☆46Updated 4 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆190Updated last year
• LeonGuertler / UnstableBaselines
  ☆90Updated this week
• tokenbender / avataRL
  rl from zero pretrain, can it be done? we'll see.
  ☆65Updated 3 weeks ago
• stanford-cs336 / assignment2-systems
  ☆41Updated 2 months ago
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆63Updated last month
• neubig / minllama-assignment
  ☆88Updated 9 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆59Updated 2 months ago
• Cohere-Labs-Community / AI-Alignment-Cohort
  ☆27Updated 9 months ago
• jax-ml / scaling-book
  Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
  ☆424Updated last week
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆154Updated 2 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 5 months ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆87Updated 2 weeks ago
• stanford-cs336 / spring2024-assignment1-basics
  ☆53Updated last year
• google-deepmind / mishax
  ☆134Updated 3 months ago
• kvfrans / lmpo
  ☆66Updated last week
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆131Updated 2 years ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆129Updated this week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆46Updated 2 weeks ago
• spiral-rl / spiral
  SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learning
  ☆103Updated last week
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆29Updated this week
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆497Updated last week