Alternatives and similar repositories for carbs:

Users that are interested in carbs are comparing it to the libraries listed below

• google-deepmind / nanodo
  ☆201Updated 6 months ago
• facebookresearch / minimax
  Efficient baselines for autocurricula in JAX.
  ☆175Updated 4 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆136Updated 6 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆75Updated last month
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆121Updated 9 months ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆129Updated 2 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆132Updated this week
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆28Updated 2 months ago
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆123Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆102Updated last month
• pytorch-labs / LeanRL
  LeanRL is a fork of CleanRL, where selected PyTorch scripts optimized for performance using compile and cudagraphs.
  ☆486Updated 2 months ago
• balrog-ai / BALROG
  Benchmarking Agentic LLM and VLM Reasoning On Games
  ☆88Updated last week
• nikhilvyas / SOAP
  ☆146Updated last month
• natolambert / rlhf-book
  Textbook on reinforcement learning from human feedback
  ☆111Updated this week
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆175Updated this week
• keraJLi / rejax
  ☆175Updated last month
• Aleph-Alpha / scaling
  Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…
  ☆54Updated 2 months ago
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆210Updated last week
• lowrollr / turbozero
  fast + parallel AlphaZero in JAX
  ☆90Updated 3 weeks ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆90Updated last month
• stanford-crfm / haliax
  Named Tensors for Legible Deep Learning in JAX
  ☆157Updated last week
• epignatelli / navix
  Accelerated minigrid environments with JAX
  ☆127Updated 5 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆182Updated 7 months ago
• ClashLuke / HeavyBall
  Efficient optimizers
  ☆144Updated this week
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆135Updated 10 months ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆44Updated 6 months ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆198Updated last year
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆110Updated last month
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆128Updated 6 months ago
• rwitten / HighPerfLLMs2024
  ☆267Updated 6 months ago