shengliu66 / ICV
Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
☆167Updated last month
Alternatives and similar repositories for ICV:
Users that are interested in ICV are comparing it to the libraries listed below
- Function Vectors in Large Language Models (ICLR 2024)☆149Updated last week
- ☆93Updated last year
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆133Updated last month
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆107Updated 11 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆102Updated 5 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆119Updated 7 months ago
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆109Updated 8 months ago
- Steering Llama 2 with Contrastive Activation Addition☆131Updated 10 months ago
- ☆169Updated last year
- ☆156Updated 2 weeks ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆52Updated 3 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆34Updated 2 months ago
- General-purpose activation steering library☆52Updated 2 months ago
- What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆63Updated 3 weeks ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆195Updated 5 months ago
- PASTA: Post-hoc Attention Steering for LLMs☆113Updated 4 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆218Updated 4 months ago
- AI Logging for Interpretability and Explainability🔬☆108Updated 9 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆82Updated last year
- Evaluating LLMs with fewer examples☆147Updated 11 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆104Updated this week
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆90Updated 5 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆90Updated last month
- The Paper List on Data Contamination for Large Language Models Evaluation.☆90Updated 3 weeks ago
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆67Updated 11 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆196Updated this week
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆151Updated last year
- ☆142Updated 11 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆136Updated 4 months ago
- ☆119Updated 5 months ago