📄Small Batch Size Training for Language Models
☆89Mar 18, 2026Updated 7 months ago
Alternatives and similar repositories for batch-size
Users that are interested in batch-size are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity: https://metr.org/blog/2025-07-10-early-2025-ai-e…☆17Feb 23, 2026Updated 8 months ago
- Efficient non-uniform quantization with GPTQ for GGUF☆68Sep 17, 2025Updated last year
- 🔀 yet another mixture of experts☆23Jun 5, 2026Updated 5 months ago
- ☆20Sep 6, 2025Updated last year
- ☆15Sep 29, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆18Sep 22, 2024Updated 2 years ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆18Apr 30, 2025Updated last year
- LLM pretraining in pure JAX☆16Apr 1, 2026Updated 7 months ago
- Code for DASH, a faster alternative to Distributed Shampoo via block stacking.☆13Feb 18, 2026Updated 8 months ago
- Source code to accompany research paper on training multi token prediction language models using self-distillation.☆42Feb 21, 2026Updated 8 months ago
- A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks☆38Oct 31, 2024Updated 2 years ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆32Aug 19, 2025Updated last year
- ☆36Apr 12, 2024Updated 2 years ago
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆19Mar 15, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆13Sep 16, 2024Updated 2 years ago
- A simple reference implementation of the single-worker MuLoCo optimizer in Jax & PyTorch. MuLoCo-1 has been shown to outperfrom Muon and …☆31Feb 27, 2026Updated 8 months ago
- A computer algebra system written in Haskell☆11May 13, 2025Updated last year
- ☆54May 20, 2024Updated 2 years ago
- solving nethack together! @:@:@:@:@☆27Oct 2, 2026Updated last month
- Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence☆72Nov 11, 2025Updated last year
- Toy meta-RL environments for testing algorithms implementations☆10Feb 21, 2024Updated 2 years ago
- Efficient Knowledge Injection in LLMs via Self-Distillation (TMLR)☆13Aug 5, 2025Updated last year
- OCR normalization (Article repo)☆20Oct 21, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Minimal and highly hackable implementation of Looped Transformers with GPT☆27Mar 8, 2026Updated 8 months ago
- ☆14May 4, 2026Updated 6 months ago
- ☆21Nov 4, 2025Updated last year
- [TMLR 2024] Revisiting Random Weight Perturbation for Efficiently Improving Generalization☆13Oct 18, 2024Updated 2 years ago
- A simple, performant and scalable JAX-based world modeling codebase.☆164Jan 15, 2026Updated 9 months ago
- ☆24May 12, 2026Updated 6 months ago
- ☆10Jun 27, 2024Updated 2 years ago
- Code for lin-RFM used for sparse recovery tasks☆17Mar 13, 2025Updated last year
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official PyTorch implementation of "Latent Reasoning in TRMs is Secretly a Policy Improvement Operator" (ICML 2026)☆26May 29, 2026Updated 5 months ago
- PyTorch-ready drop-in Triton-based Gated SSM for ultra-long sequences. Heavily optimized. Suitable for pre-training and fine-tuning.☆10Dec 16, 2025Updated 10 months ago
- Merge of megatron-train, autoexperiment and oellm_pretrain.☆19Updated this week
- 📄 Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay☆26Jul 17, 2026Updated 3 months ago
- Testing Percepta's claim that transformers can execute programs via 2D convex hull attention☆11Sep 7, 2026Updated 2 months ago
- Agen is a minimalist language for agent loops and state machines.☆49Mar 30, 2026Updated 7 months ago
- Object-Centric-Representation Library (OCRL): This repo is to explore OCR on various downstream tasks from supervised learning tasks to R…☆12Feb 23, 2024Updated 2 years ago
Are these results useful?