πSmall Batch Size Training for Language Models
β80Oct 4, 2025Updated 5 months ago
Alternatives and similar repositories for batch-size
Users that are interested in batch-size are comparing it to the libraries listed below
Sorting:
- β35Apr 12, 2024Updated last year
- Implementation of Hyena Hierarchy in JAXβ10Apr 30, 2023Updated 2 years ago
- β10Jun 27, 2024Updated last year
- Code for "What really matters in matrix-whitening optimizers?"β22Oct 31, 2025Updated 4 months ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"β14Apr 30, 2025Updated 10 months ago
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.β31Nov 4, 2024Updated last year
- Official Implementation of `An Optimisation Framework for Unsupervised Environment Design` from RLC 2025β17Nov 24, 2025Updated 3 months ago
- GoldFinch and other hybrid transformer componentsβ12Dec 9, 2025Updated 2 months ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"β29Jul 30, 2020Updated 5 years ago
- β16Jul 16, 2024Updated last year
- Pointax: PointMaze Environment for JAXβ26Oct 22, 2025Updated 4 months ago
- Code for lin-RFM used for sparse recovery tasksβ15Mar 13, 2025Updated 11 months ago
- β13Jan 15, 2025Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAXβ93Jan 25, 2024Updated 2 years ago
- β15Sep 22, 2024Updated last year
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learningβ14Jun 19, 2024Updated last year
- Attention Kernels for Symmetric Power Transformersβ129Sep 25, 2025Updated 5 months ago
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasksβ36Oct 31, 2024Updated last year
- VC-FB and MC-FB algorithms from "Zero-Shot Reinforcement Learning from Low Quality Data" (NeurIPS 2024)β26Jan 14, 2025Updated last year
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspaceβ18Oct 21, 2024Updated last year
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features disβ¦β21Nov 25, 2024Updated last year
- Official codebase for "Sampling For Learnability", published at NeurIPS 2024β20Oct 21, 2025Updated 4 months ago
- β19May 20, 2025Updated 9 months ago
- Official implementation of "Latent Action Learning Requires Supervision in the Presence of Distractors", ICML 2025β33Jul 8, 2025Updated 7 months ago
- Training hybrid models for dummies.β29Nov 1, 2025Updated 4 months ago
- Parallel Associative Scan for Language Modelsβ18Jan 8, 2024Updated 2 years ago
- β18Aug 20, 2025Updated 6 months ago
- Neuroevolution Benchmark in JAX π¦β42Nov 5, 2023Updated 2 years ago
- Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"β169Jan 16, 2025Updated last year
- llama2 in Juliaβ14Jul 24, 2023Updated 2 years ago
- β19Apr 22, 2024Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.β19Oct 21, 2024Updated last year
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"β92Oct 30, 2024Updated last year
- AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)β23Oct 15, 2024Updated last year
- High-performance JAX-powered simulator for robotic navigation in 2D mazes, optimized for Quality-Diversity algorithm research and benchmaβ¦β20Jun 19, 2025Updated 8 months ago
- Scalable and Stable Parallelization of Nonlinear RNNSβ29Oct 21, 2025Updated 4 months ago
- β92Feb 16, 2026Updated 2 weeks ago
- Scalable Opponent Shaping Experiments in JAXβ25Apr 13, 2024Updated last year
- Code of the Paper "Time-Efficient Reinforcement Learning with Stochastic Stateful Policies"β25May 5, 2024Updated last year