Alternatives and similar repositories for attention-viz

Users that are interested in attention-viz are comparing it to the libraries listed below

• wesg52 / world-models
  Extracting spatial and temporal world models from LLMs
  ☆256Updated 2 years ago
• google-deepmind / mishax
  ☆144Updated 3 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆269Updated 7 months ago
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆197Updated 2 years ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆131Updated 3 years ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 10 months ago
• joshuacnf / Ctrl-G
  ☆105Updated 11 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆198Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆242Updated 9 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆179Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆49Updated last year
• neulab / gemini-benchmark
  ☆150Updated last year
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆239Updated 10 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆207Updated last year
• srush / do-we-need-attention
  ☆167Updated 2 years ago
• lukasberglund / reversal_curse
  ☆300Updated 2 years ago
• wolfecameron / lora_instruction_tune
  ☆38Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆554Updated 4 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆232Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆220Updated 2 years ago
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆202Updated 2 years ago
• jakespringer / echo-embeddings
  ☆159Updated last year
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆93Updated last year
• bartbussmann / BatchTopK
  Implementation of the BatchTopK activation function for training sparse autoencoders (SAEs)
  ☆57Updated 4 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆84Updated last year
• snap-stanford / MLAgentBench
  ☆321Updated last year
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆258Updated 8 months ago
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆161Updated 11 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 5 months ago