📄Small Batch Size Training for Language Models
☆80Oct 4, 2025Updated 5 months ago
Alternatives and similar repositories for batch-size
Users that are interested in batch-size are comparing it to the libraries listed below
Sorting:
- ☆35Apr 12, 2024Updated last year
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 2 years ago
- ☆10Jun 27, 2024Updated last year
- Code for "What really matters in matrix-whitening optimizers?"☆22Oct 31, 2025Updated 4 months ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆14Apr 30, 2025Updated 10 months ago
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.☆31Nov 4, 2024Updated last year
- Official Implementation of `An Optimisation Framework for Unsupervised Environment Design` from RLC 2025☆17Nov 24, 2025Updated 3 months ago
- GoldFinch and other hybrid transformer components☆12Dec 9, 2025Updated 2 months ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆29Jul 30, 2020Updated 5 years ago
- ☆16Jul 16, 2024Updated last year
- Pointax: PointMaze Environment for JAX☆26Oct 22, 2025Updated 4 months ago
- Code for lin-RFM used for sparse recovery tasks☆15Mar 13, 2025Updated 11 months ago
- ☆13Jan 15, 2025Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆93Jan 25, 2024Updated 2 years ago
- ☆15Sep 22, 2024Updated last year
- XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning☆14Jun 19, 2024Updated last year
- Attention Kernels for Symmetric Power Transformers☆129Sep 25, 2025Updated 5 months ago
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks☆36Oct 31, 2024Updated last year
- VC-FB and MC-FB algorithms from "Zero-Shot Reinforcement Learning from Low Quality Data" (NeurIPS 2024)☆26Jan 14, 2025Updated last year
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆18Oct 21, 2024Updated last year
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆21Nov 25, 2024Updated last year
- Official codebase for "Sampling For Learnability", published at NeurIPS 2024☆20Oct 21, 2025Updated 4 months ago
- ☆19May 20, 2025Updated 9 months ago
- Official implementation of "Latent Action Learning Requires Supervision in the Presence of Distractors", ICML 2025☆33Jul 8, 2025Updated 7 months ago
- Training hybrid models for dummies.☆29Nov 1, 2025Updated 4 months ago
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- ☆18Aug 20, 2025Updated 6 months ago
- Neuroevolution Benchmark in JAX 🦕☆42Nov 5, 2023Updated 2 years ago
- Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"☆169Jan 16, 2025Updated last year
- llama2 in Julia☆14Jul 24, 2023Updated 2 years ago
- ☆19Apr 22, 2024Updated last year
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated last year
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆92Oct 30, 2024Updated last year
- AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)☆23Oct 15, 2024Updated last year
- High-performance JAX-powered simulator for robotic navigation in 2D mazes, optimized for Quality-Diversity algorithm research and benchma…☆20Jun 19, 2025Updated 8 months ago
- Scalable and Stable Parallelization of Nonlinear RNNS☆29Oct 21, 2025Updated 4 months ago
- ☆92Feb 16, 2026Updated 2 weeks ago
- Scalable Opponent Shaping Experiments in JAX☆25Apr 13, 2024Updated last year
- Code of the Paper "Time-Efficient Reinforcement Learning with Stochastic Stateful Policies"☆25May 5, 2024Updated last year