Alternatives and similar repositories for attention:

Users that are interested in attention are comparing it to the libraries listed below

• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆105Updated 6 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆169Updated last month
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆240Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆148Updated 11 months ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆136Updated 10 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆217Updated 4 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆228Updated 2 months ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆231Updated last month
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆93Updated last month
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆166Updated this week
• meg-tong / sycophancy-eval
  datasets from the paper "Towards Understanding Sycophancy in Language Models"
  ☆74Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆154Updated 3 weeks ago
• da03 / Internalize_CoT_Step_by_Step
  ☆163Updated last month
• nrimsky / LM-exp
  LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces
  ☆91Updated last year
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆216Updated 6 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆335Updated 6 months ago
• jakespringer / echo-embeddings
  ☆144Updated 11 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆192Updated 3 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆62Updated last month
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆121Updated last year
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆91Updated last week
• prateeky2806 / ties-merging
  ☆172Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆337Updated last year
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆474Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆113Updated 4 months ago
• andyrdt / refusal_direction
  Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".
  ☆202Updated 6 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• lukasberglund / reversal_curse
  ☆288Updated last year
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆126Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆132Updated 5 months ago