Alternatives and similar repositories for attention

Users that are interested in attention are comparing it to the libraries listed below

• lukasberglund / reversal_curse
  ☆295Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 10 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆530Updated 2 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆110Updated 4 months ago
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆223Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆246Updated 7 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆297Updated 3 months ago
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆253Updated 6 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆190Updated 7 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆221Updated 9 months ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆516Updated last year
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆204Updated 11 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆170Updated 4 months ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆215Updated last week
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆234Updated 7 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆213Updated last month
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆122Updated 10 months ago
• vec2text / vec2text
  utilities for decoding deep representations (like sentence embeddings) back to text
  ☆949Updated 2 months ago
• collin-burns / discovering_latent_knowledge
  ☆276Updated last year
• huggingface / cosmopedia
  ☆541Updated 10 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆98Updated 10 months ago
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆116Updated 2 years ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆125Updated 7 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆236Updated 8 months ago
• jakespringer / echo-embeddings
  ☆155Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆187Updated last year