Alternatives and similar repositories for attention-viz

Users that are interested in attention-viz are comparing it to the libraries listed below

• wesg52 / world-models
  Extracting spatial and temporal world models from LLMs
  ☆257Updated 2 years ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 11 months ago
• google-deepmind / mishax
  ☆152Updated 4 months ago
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆199Updated 2 years ago
• joshuacnf / Ctrl-G
  ☆105Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆269Updated 8 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆179Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆49Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆209Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆247Updated 11 months ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆133Updated 3 years ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆198Updated last year
• neulab / gemini-benchmark
  ☆150Updated 2 years ago
• KaiNylund / lm-weights-encode-time
  ☆68Updated last year
• jakespringer / echo-embeddings
  ☆161Updated last year
• lukasberglund / reversal_curse
  ☆302Updated 2 years ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆238Updated last year
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆527Updated 2 years ago
• PolymathicAI / xVal
  Repository for code used in the xVal paper
  ☆148Updated last year
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 7 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆222Updated 2 years ago
• SALT-NLP / demonstrated-feedback
  ☆129Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆202Updated 2 years ago
• lz1oceani / verify_cot
  ☆139Updated 2 years ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆116Updated last year
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆160Updated last year
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆242Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆565Updated 5 months ago