Alternatives and similar repositories for picotron

Users that are interested in picotron are comparing it to the libraries listed below

• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,407Updated 3 weeks ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆2,211Updated last year
• policy-gradient / GRPO-Zero
  Implementing DeepSeek R1's GRPO algorithm from scratch
  ☆1,729Updated 8 months ago
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆4,924Updated this week
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆4,085Updated this week
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆557Updated 2 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆3,028Updated 3 weeks ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,140Updated last year
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆829Updated 5 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆2,226Updated 3 weeks ago
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆2,611Updated this week
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,397Updated 5 months ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆587Updated 2 years ago
• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆1,382Updated this week
• gpu-mode / awesomeMLSys
  An ML Systems Onboarding list
  ☆960Updated 11 months ago
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆575Updated 2 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,217Updated last year
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆4,400Updated this week
• NVIDIA-NeMo / RL
  Scalable toolkit for efficient model reinforcement
  ☆1,193Updated last week
• jax-ml / scaling-book
  Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
  ☆801Updated this week
• thinking-machines-lab / batch_invariant_ops
  ☆945Updated 2 months ago
• gpu-mode / resource-stream
  GPU programming related news and material links
  ☆1,881Updated 3 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,123Updated 7 months ago
• THUDM / slime
  slime is an LLM post-training framework for RL Scaling.
  ☆3,086Updated this week
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆658Updated last year
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,430Updated 4 months ago
• meta-pytorch / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆1,096Updated last week
• fla-org / flash-linear-attention
  🚀 Efficient implementations of state-of-the-art linear attention models
  ☆4,168Updated last week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆590Updated 4 months ago
• sgl-project / mini-sglang
  A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
  ☆2,709Updated last week