shengliu66 / ICV
Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
☆162Updated last week
Alternatives and similar repositories for ICV:
Users that are interested in ICV are comparing it to the libraries listed below
- Function Vectors in Large Language Models (ICLR 2024)☆138Updated 4 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆126Updated this week
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆104Updated 10 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆157Updated this week
- ☆165Updated last year
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆118Updated 6 months ago
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆151Updated last year
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆108Updated 7 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆92Updated this week
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆182Updated 2 months ago
- ☆89Updated last year
- ☆149Updated last week
- Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"☆98Updated 4 months ago
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆84Updated 4 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆71Updated last month
- Benchmarking LLMs with Challenging Tasks from Real Users☆215Updated 3 months ago
- Code accompanying "How I learned to start worrying about prompt formatting".☆102Updated 4 months ago
- PASTA: Post-hoc Attention Steering for LLMs☆111Updated 2 months ago
- ☆116Updated 3 months ago
- [NAACL'25] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆47Updated 2 months ago
- A Survey on Data Selection for Language Models☆210Updated 4 months ago
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆100Updated 7 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆33Updated last month
- Critique-out-Loud Reward Models☆51Updated 4 months ago
- Codebase for reproducing the experiments of the semantic uncertainty paper (paragraph-length experiments).☆53Updated 10 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Updated last year
- General-purpose activation steering library☆43Updated last month
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆65Updated 11 months ago
- Steering Llama 2 with Contrastive Activation Addition☆123Updated 8 months ago