MaxBelitsky / cache-steeringLinks
KV Cache Steering for Inducing Reasoning in Small Language Models
☆42Updated 4 months ago
Alternatives and similar repositories for cache-steering
Users that are interested in cache-steering are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- ☆55Updated last year
- ☆89Updated last year
- Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"☆61Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 10 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆37Updated 2 months ago
- ☆79Updated 3 weeks ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆93Updated last year
- Aioli: A unified optimization framework for language model data mixing☆31Updated 10 months ago
- ☆87Updated this week
- Resa: Transparent Reasoning Models via SAEs☆45Updated 2 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 7 months ago
- Fork of Flame repo for training of some new stuff in development☆19Updated last week
- MEXMA: Token-level objectives improve sentence representations☆42Updated 11 months ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆31Updated 6 months ago
- Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."☆51Updated 2 months ago
- Lottery Ticket Adaptation☆40Updated last year
- MatFormer repo☆66Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated 2 months ago
- UQ: Assessing Language Models on Unsolved Questions☆29Updated 3 months ago
- A repository for research on medium sized language models.☆78Updated last year
- ☆70Updated last year
- ☆67Updated 8 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Updated 9 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 7 months ago
- ☆29Updated last month
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆58Updated last week
- Supercharge huggingface transformers with model parallelism.☆77Updated 4 months ago
- ☆24Updated last year