imbue-ai / carbs
Cost aware hyperparameter tuning algorithm
☆150Updated 10 months ago
Alternatives and similar repositories for carbs:
Users that are interested in carbs are comparing it to the libraries listed below
- seqax = sequence modeling + JAX☆155Updated 3 weeks ago
- ☆217Updated 9 months ago
- Efficient optimizers☆190Updated this week
- 🧱 Modula software package☆188Updated last month
- Efficient baselines for autocurricula in JAX.☆186Updated 8 months ago
- prime-rl is a codebase for decentralized RL training at scale☆85Updated this week
- ☆105Updated this week
- supporting pytorch FSDP for optimizers☆80Updated 4 months ago
- A simple library for scaling up JAX programs☆134Updated 6 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆123Updated last year
- ☆145Updated 3 weeks ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆105Updated this week
- Latent Program Network (from the "Searching Latent Program Spaces" paper)☆82Updated last month
- LeanRL is a fork of CleanRL, where selected PyTorch scripts optimized for performance using compile and cudagraphs.☆559Updated 6 months ago
- Understand and test language model architectures on synthetic tasks.☆194Updated last month
- A MAD laboratory to improve AI architecture designs 🧪☆113Updated 4 months ago
- Minimal but scalable implementation of large language models in JAX☆34Updated 6 months ago
- Benchmarking Agentic LLM and VLM Reasoning On Games☆133Updated last week
- Efficient World Models with Context-Aware Tokenization. ICML 2024☆98Updated 7 months ago
- Solve puzzles. Learn CUDA.☆64Updated last year
- Named Tensors for Legible Deep Learning in JAX☆172Updated this week
- A set of Python scripts that makes your experience on TPU better☆52Updated 10 months ago
- ⚡ Flashbax: Accelerated Replay Buffers in JAX☆234Updated last month
- LoRA for arbitrary JAX models and functions☆136Updated last year
- A puzzle to learn about prompting☆127Updated last year
- Hardware-Accelerated Reinforcement Learning Algorithms in pure Jax!☆205Updated last month
- Train very large language models in Jax.☆204Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆569Updated this week
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆258Updated last week
- ☆94Updated 3 months ago