Alternatives and similar repositories for attention-viz:

Users that are interested in attention-viz are comparing it to the libraries listed below

• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆195Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆88Updated last month
• google-deepmind / mishax
  ☆123Updated last month
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆478Updated 9 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆70Updated 3 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆186Updated 9 months ago
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆150Updated last year
• EleutherAI / delphi
  ☆159Updated this week
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆88Updated last year
• wolfecameron / lora_instruction_tune
  ☆40Updated 10 months ago
• KaiNylund / lm-weights-encode-time
  ☆67Updated 6 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆112Updated last year
• SALT-NLP / demonstrated-feedback
  ☆119Updated 5 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• lz1oceani / verify_cot
  ☆130Updated last year
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆130Updated 10 months ago
• xu3kev / BARC
  Bootstrapping ARC
  ☆103Updated 3 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆174Updated 6 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆113Updated 3 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆184Updated 2 months ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆46Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 5 months ago
• neulab / gemini-benchmark
  ☆150Updated last year
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆79Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆84Updated 5 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆142Updated 5 months ago
• steering-vectors / steering-vectors
  Steering vectors for transformer language models in Pytorch / Huggingface
  ☆90Updated 2 weeks ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆159Updated 2 months ago
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆185Updated 3 months ago
• prateeky2806 / ties-merging
  ☆167Updated last year