mattneary / attention

Related projects ⓘ

Alternatives and complementary repositories for attention

• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆152Updated last month
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆211Updated last month
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆134Updated 7 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆158Updated last month
• google / sycophancy-intervention
  Scripts for generating synthetic finetuning data for reducing sycophancy.
  ☆106Updated last year
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆143Updated 3 weeks ago
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆74Updated this week
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆118Updated last month
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆228Updated 8 months ago
• jakespringer / echo-embeddings
  ☆124Updated 6 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆208Updated 3 weeks ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆434Updated 9 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆60Updated last month
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆321Updated last month
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆188Updated 2 months ago
• EleutherAI / sae
  Sparse autoencoders
  ☆336Updated 3 weeks ago
• EleutherAI / sae-auto-interp
  ☆105Updated this week
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆107Updated 2 months ago
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆68Updated last year
• kaistAI / FLASK
  [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
  ☆210Updated 10 months ago
• huggingface / cosmopedia
  ☆447Updated 2 weeks ago
• lilakk / BooookScore
  A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…
  ☆105Updated last month
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆464Updated last month
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆95Updated 5 months ago
• msclar / formatspread
  Code accompanying "How I learned to start worrying about prompt formatting".
  ☆92Updated last month
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆156Updated 6 months ago
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆216Updated 7 months ago
• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆287Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆435Updated 7 months ago