msakarvadia / memorizationLinks
Localizing Memorized Sequences in Language Models
☆20Updated 3 months ago
Alternatives and similar repositories for memorization
Users that are interested in memorization are comparing it to the libraries listed below
Sorting:
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆104Updated this week
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆79Updated last year
- Conformal Language Modeling☆32Updated 2 years ago
- ☆35Updated 7 months ago
- AI Logging for Interpretability and Explainability🔬☆138Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Updated 3 months ago
- ☆53Updated 9 months ago
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆14Updated 2 years ago
- Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"☆29Updated last year
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆55Updated 2 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆78Updated 2 years ago
- ☆51Updated 2 years ago
- Codebase for Linguistic Collapse: Neural Collapse in (Large) Language Models [NeurIPS 2024] [arXiv:2405.17767]☆17Updated 9 months ago
- Learning adapter weights from task descriptions☆19Updated 2 years ago
- ☆70Updated 6 months ago
- [EMNLP 2025 Main] ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆40Updated 5 months ago
- Lightweight Adapting for Black-Box Large Language Models☆24Updated last year
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆99Updated 4 years ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆36Updated 9 months ago
- Interpretating the latent space representations of attention head outputs for LLMs☆36Updated last year
- Influence Analysis and Estimation - Survey, Papers, and Taxonomy☆84Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆69Updated 2 weeks ago
- ☆80Updated 3 years ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆85Updated 10 months ago
- Trains Sparse Autoencoders based on outputs from language models☆11Updated last year
- Code for ACL 2023 paper "BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases".☆22Updated 2 years ago
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆19Updated 7 months ago
- Official implementation of Vector-ICL: In-context Learning with Continuous Vector Representations (ICLR 2025)☆21Updated 7 months ago
- Official implementation of GOAT model (ICML2023)☆38Updated 2 years ago
- Confidence Regulation Neurons in Language Models (NeurIPS 2024)☆15Updated 11 months ago