shengliu66 / ICV
Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
☆154Updated 3 months ago
Alternatives and similar repositories for ICV:
Users that are interested in ICV are comparing it to the libraries listed below
- ☆159Updated 11 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆131Updated 3 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆120Updated last month
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆97Updated 3 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆206Updated 2 months ago
- ☆137Updated 9 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆153Updated last month
- PASTA: Post-hoc Attention Steering for LLMs☆109Updated last month
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆102Updated 9 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆153Updated 3 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆117Updated 5 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆97Updated 3 months ago
- ☆135Updated 3 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆97Updated 6 months ago
- A Survey on Data Selection for Language Models☆201Updated 3 months ago
- The Paper List on Data Contamination for Large Language Models Evaluation.☆86Updated last week
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆73Updated 3 months ago
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆64Updated 9 months ago
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆106Updated 6 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆129Updated 2 months ago
- ☆113Updated 2 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆82Updated this week
- ☆85Updated last year
- ☆115Updated 3 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆80Updated 10 months ago
- What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆52Updated 2 months ago
- AI Logging for Interpretability and Explainability🔬☆97Updated 7 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆175Updated last month
- LoFiT: Localized Fine-tuning on LLM Representations☆30Updated this week
- Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆39Updated last month