Alternatives and similar repositories for attention

Users that are interested in attention are comparing it to the libraries listed below

• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆226Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆248Updated last year
• lukasberglund / reversal_curse
  ☆300Updated 2 years ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆535Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆113Updated 7 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆196Updated 11 months ago
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆224Updated last year
• jakespringer / echo-embeddings
  ☆162Updated last year
• huggingface / cosmopedia
  ☆557Updated last year
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆225Updated last month
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆222Updated last month
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆321Updated last week
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆128Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆278Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆237Updated last year
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆137Updated 10 months ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆189Updated 2 years ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆202Updated 8 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆373Updated 2 years ago
• collin-burns / discovering_latent_knowledge
  ☆283Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆145Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆236Updated this week
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆560Updated 5 months ago
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆324Updated last year
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆313Updated last year
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆261Updated 9 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆253Updated last year