Alternatives and similar repositories for attention-viz

Users that are interested in attention-viz are comparing it to the libraries listed below

• wesg52 / world-models
  Extracting spatial and temporal world models from LLMs
  ☆257Updated 2 years ago
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆191Updated 2 years ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆549Updated 3 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 5 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆111Updated 9 months ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆130Updated 3 years ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆269Updated 6 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆194Updated last year
• google-deepmind / mishax
  ☆143Updated 2 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆178Updated last year
• lukasberglund / reversal_curse
  ☆297Updated 2 years ago
• lucidrains / simple-hierarchical-transformer
  Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
  ☆224Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆205Updated last year
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• mlfoundations / task_vectors
  Editing Models with Task Arithmetic
  ☆515Updated last year
• srush / do-we-need-attention
  ☆166Updated 2 years ago
• snap-stanford / MLAgentBench
  ☆316Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆168Updated 9 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆260Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆228Updated 11 months ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆90Updated last year
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆154Updated 2 years ago
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆201Updated 2 years ago
• llm-random / llm-random
  ☆205Updated 2 weeks ago
• lz1oceani / verify_cot
  ☆136Updated 2 years ago
• neulab / gemini-benchmark
  ☆150Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆257Updated 2 years ago
• wolfecameron / lora_instruction_tune
  ☆38Updated last year
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆239Updated 10 months ago
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆240Updated 9 months ago