aviclu / ffn-values
☆61Updated last year
Alternatives and similar repositories for ffn-values:
Users that are interested in ffn-values are comparing it to the libraries listed below
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆90Updated 3 years ago
- Code for "Tracing Knowledge in Language Models Back to the Training Data"☆37Updated 2 years ago
- ☆85Updated 2 years ago
- ☆44Updated 6 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆75Updated last year
- ☆37Updated last year
- Inspecting and Editing Knowledge Representations in Language Models☆112Updated last year
- ☆92Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆69Updated last week
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆74Updated last year
- ☆52Updated last year
- Restore safety in fine-tuned language models through task arithmetic☆27Updated 11 months ago
- ☆30Updated 10 months ago
- ☆47Updated last year
- ☆22Updated 3 weeks ago
- A library for efficient patching and automatic circuit discovery.☆57Updated last month
- ☆47Updated 7 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆50Updated 3 months ago
- ☆74Updated last year
- LoFiT: Localized Fine-tuning on LLM Representations☆34Updated 2 months ago
- ☆48Updated 11 months ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆66Updated 2 years ago
- AI Logging for Interpretability and Explainability🔬☆107Updated 9 months ago
- Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models☆43Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated 2 years ago
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆17Updated 10 months ago
- ☆18Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆58Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆21Updated 9 months ago