Alternatives and similar repositories for attention

Users that are interested in attention are comparing it to the libraries listed below

• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• lukasberglund / reversal_curse
  ☆297Updated 2 years ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated last year
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆532Updated last year
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆128Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆549Updated 3 months ago
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆257Updated 8 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆112Updated 5 months ago
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆223Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆319Updated last year
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆193Updated 9 months ago
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆201Updated 2 years ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆189Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆250Updated 9 months ago
• huggingface / cosmopedia
  ☆556Updated last year
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆266Updated last year
• Re-Align / URIAL
  ☆313Updated last year
• jakespringer / echo-embeddings
  ☆157Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆129Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆310Updated 2 weeks ago
• facebookresearch / SemDeDup
  Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…
  ☆147Updated 2 years ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆130Updated 9 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆199Updated 7 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 5 months ago
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆560Updated 10 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆231Updated 11 months ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆216Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆240Updated 9 months ago
• collin-burns / discovering_latent_knowledge
  ☆283Updated last year