Alternatives and similar repositories for attention-viz

Users that are interested in attention-viz are comparing it to the libraries listed below

• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆105Updated 6 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆254Updated last year
• wesg52 / world-models
  Extracting spatial and temporal world models from LLMs
  ☆255Updated last year
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated 11 months ago
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆188Updated 2 years ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆192Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 3 months ago
• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• google-deepmind / mishax
  ☆141Updated 2 weeks ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆340Updated 2 months ago
• lukasberglund / reversal_curse
  ☆293Updated last year
• HazyResearch / TART
  TART: A plug-and-play Transformer module for task-agnostic reasoning
  ☆200Updated 2 years ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆114Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆203Updated 11 months ago
• sdascoli / boolformer
  ☆164Updated last year
• srush / do-we-need-attention
  ☆166Updated 2 years ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 10 months ago
• SALT-NLP / demonstrated-feedback
  ☆127Updated 11 months ago
• guy-dar / embedding-space
  ☆53Updated 2 years ago
• jakespringer / echo-embeddings
  ☆154Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆229Updated last month
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆186Updated last month
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆71Updated last year
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆129Updated 2 years ago
• snap-stanford / MLAgentBench
  ☆301Updated last year
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆229Updated 11 months ago
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆152Updated 8 months ago
• PolymathicAI / xVal
  Repository for code used in the xVal paper
  ☆142Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• neulab / gemini-benchmark
  ☆149Updated last year