HazyResearch / cartridgesLinks
Storing long contexts in tiny caches with self-study
☆60Updated this week
Alternatives and similar repositories for cartridges
Users that are interested in cartridges are comparing it to the libraries listed below
Sorting:
- EvaByte: Efficient Byte-level Language Models at Scale☆101Updated 2 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 8 months ago
- Experiments for efforts to train a new and improved t5☆77Updated last year
- train with kittens!☆59Updated 7 months ago
- Small, simple agent task environments for training and evaluation☆18Updated 7 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 9 months ago
- ☆51Updated 7 months ago
- The evaluation framework for training-free sparse attention in LLMs☆69Updated this week
- ☆51Updated 7 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 4 months ago
- ☆47Updated 9 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 6 months ago
- Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044☆33Updated 8 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- ☆60Updated 2 weeks ago
- Simple GRPO scripts and configurations.☆58Updated 4 months ago
- Lego for GRPO☆28Updated 3 weeks ago
- Using FlexAttention to compute attention with different masking patterns☆43Updated 9 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last month
- Aioli: A unified optimization framework for language model data mixing☆27Updated 5 months ago
- ☆44Updated last year
- Verifiers for LLM Reinforcement Learning☆60Updated 2 months ago
- A repository for research on medium sized language models.☆76Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆33Updated 3 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 10 months ago
- ☆115Updated 4 months ago
- ☆30Updated 7 months ago
- Latent Large Language Models☆18Updated 9 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆63Updated 2 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆41Updated last month