Alternatives and similar repositories for ffn-values:

Users that are interested in ffn-values are comparing it to the libraries listed below

• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆91Updated 3 years ago
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• roeehendel / icl_task_vectors
  ☆93Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆26Updated 7 months ago
• yasumasaonoe / entity_knowledge_propagation
  ☆17Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 8 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 8 months ago
• hannamw / EAP-IG
  ☆29Updated this week
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆76Updated 2 years ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆54Updated 5 months ago
• GXimingLu / Quark
  ☆75Updated last year
• swj0419 / in-context-pretraining
  ☆49Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• McGill-NLP / polytropon
  ☆53Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆72Updated last month
• MaheepChaudhary / SAE-Ravel
  Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…
  ☆11Updated 3 months ago
• explanare / ravel
  Evaluate interpretability methods on localizing and disentangling concepts in LLMs.
  ☆46Updated 7 months ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• balevinstein / Probes
  ☆50Updated last year
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• NoviScl / GPT3-Reliability
  ☆78Updated 2 years ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆64Updated 2 weeks ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• adihaviv / idiomem
  ☆9Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆76Updated last year
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• dannyallover / overthinking_the_truth
  ☆29Updated last year
• IBM / activation-steering
  General-purpose activation steering library
  ☆66Updated 4 months ago