Alternatives and similar repositories for attention:

Users that are interested in attention are comparing it to the libraries listed below

• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆88Updated last week
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆231Updated last year
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆108Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆102Updated 5 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆164Updated 2 weeks ago
• lukasberglund / reversal_curse
  ☆283Updated last year
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆71Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆152Updated 3 weeks ago
• EleutherAI / delphi
  ☆153Updated this week
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆502Updated last month
• Saibo-creator / Awesome-LLM-Constrained-Decoding
  A curated list of papers related to constrained decoding of LLM, along with their relevant code and resources.
  ☆165Updated this week
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆145Updated 10 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆333Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆140Updated 4 months ago
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆89Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆224Updated 2 weeks ago
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆293Updated 5 months ago
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆215Updated 5 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆183Updated 2 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆113Updated 3 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆187Updated 5 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆124Updated 9 months ago
• davidbau / baukit
  ☆191Updated last year
• voidism / DoLa
  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
  ☆464Updated last month
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 9 months ago
• saprmarks / geometry-of-truth
  ☆79Updated 6 months ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆464Updated last year
• chrisliu298 / awesome-representation-engineering
  A resource repository for representation engineering in large language models
  ☆107Updated 3 months ago
• Re-Align / URIAL
  ☆305Updated 8 months ago