Alternatives and similar repositories for attention

Users that are interested in attention are comparing it to the libraries listed below

• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆167Updated last year
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆223Updated last year
• lukasberglund / reversal_curse
  ☆297Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆223Updated 11 months ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆525Updated last year
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆110Updated 5 months ago
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆192Updated 9 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆305Updated 4 months ago
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆201Updated last year
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆189Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆247Updated 8 months ago
• huggingface / cosmopedia
  ☆552Updated 11 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 4 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆200Updated 6 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆265Updated last year
• neulab / gemini-benchmark
  ☆149Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆127Updated 11 months ago
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆256Updated 7 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆215Updated 2 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆172Updated 6 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆276Updated last year
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆554Updated 9 months ago
• jakespringer / echo-embeddings
  ☆156Updated last year
• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆217Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆144Updated last year
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆297Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆477Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆197Updated 6 months ago