Alternatives and similar repositories for attention

Users that are interested in attention are comparing it to the libraries listed below

• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated 9 months ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• lukasberglund / reversal_curse
  ☆293Updated last year
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆513Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆243Updated 6 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆245Updated 9 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆109Updated 2 months ago
• huggingface / cosmopedia
  ☆536Updated 9 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆295Updated last month
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆247Updated 5 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆521Updated 3 weeks ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆340Updated 2 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆216Updated 8 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆185Updated 6 months ago
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆141Updated 9 months ago
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆199Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆122Updated 9 months ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆187Updated last year
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆121Updated 6 months ago
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆198Updated 9 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆270Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆309Updated 11 months ago
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆223Updated 11 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆239Updated 10 months ago
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆543Updated 7 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆258Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆178Updated 4 months ago
• jayelm / gisting
  Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467
  ☆291Updated 6 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆214Updated last month