Alternatives and similar repositories for attention-viz

Users that are interested in attention-viz are comparing it to the libraries listed below

• neulab / gemini-benchmark
  ☆150Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 7 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆189Updated 11 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆197Updated last year
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆181Updated last year
• SALT-NLP / demonstrated-feedback
  ☆120Updated 7 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 3 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆490Updated 11 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆195Updated 2 months ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆115Updated last year
• llm-random / llm-random
  ☆189Updated this week
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆153Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆166Updated last month
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆94Updated 3 months ago
• prateeky2806 / ties-merging
  ☆180Updated last year
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆246Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆201Updated 5 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆176Updated 8 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• google-deepmind / mishax
  ☆129Updated last month
• lucidrains / recurrent-memory-transformer-pytorch
  Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
  ☆407Updated 4 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆199Updated last week
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆144Updated 4 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆115Updated 5 months ago
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆89Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆117Updated 5 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated last year
• sanjayss34 / codevqa
  ☆85Updated last year
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆223Updated 2 months ago