matchten / LoRA-Models-for-SAEsLinks
Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
☆10Updated 2 months ago
Alternatives and similar repositories for LoRA-Models-for-SAEs
Users that are interested in LoRA-Models-for-SAEs are comparing it to the libraries listed below
Sorting:
- ☆32Updated 5 months ago
- ☆20Updated 11 months ago
- ☆14Updated last year
- Exploration of automated dataset selection approaches at large scales.☆45Updated 3 months ago
- ☆26Updated 4 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆32Updated 3 months ago
- Universal Neurons in GPT2 Language Models☆29Updated last year
- ☆20Updated last month
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 5 months ago
- We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.☆22Updated 6 months ago
- The repository contains code for Adaptive Data Optimization☆25Updated 6 months ago
- ☆19Updated 3 months ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆37Updated 7 months ago
- ☆19Updated 11 months ago
- Sparse Autoencoder Training Library☆52Updated last month
- Efficient Scaling laws and collaborative pretraining.☆16Updated 4 months ago
- ☆17Updated 5 months ago
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆14Updated last week
- Codebase for Instruction Following without Instruction Tuning☆34Updated 9 months ago
- Code for "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining"☆18Updated 2 months ago
- implementation of dualformer☆17Updated 3 months ago
- ☆23Updated 4 months ago
- ☆18Updated 2 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆75Updated 6 months ago
- Lottery Ticket Adaptation☆39Updated 7 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 9 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆95Updated 2 weeks ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 5 months ago