Alternatives and similar repositories for attention-viz

Users that are interested in attention-viz are comparing it to the libraries listed below

• wesg52 / world-models
  Extracting spatial and temporal world models from LLMs
  ☆257Updated 2 years ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 5 months ago
• google-deepmind / mishax
  ☆142Updated last month
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆191Updated 2 years ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆109Updated 8 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆192Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated last year
• wolfecameron / lora_instruction_tune
  ☆38Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 3 months ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆129Updated 3 years ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆238Updated 7 months ago
• neulab / gemini-benchmark
  ☆149Updated last year
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆257Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆203Updated last year
• SALT-NLP / demonstrated-feedback
  ☆128Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆532Updated 2 months ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• PolymathicAI / xVal
  Repository for code used in the xVal paper
  ☆144Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆217Updated 2 years ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆221Updated 10 months ago
• stanford-crfm / ecosystem-graphs
  ☆267Updated 8 months ago
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆154Updated 9 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆233Updated 3 weeks ago
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆508Updated last year
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆200Updated 2 years ago
• lz1oceani / verify_cot
  ☆134Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆233Updated 2 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆163Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆46Updated last year
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆253Updated 6 months ago