Alternatives and similar repositories for MambaLens:

Users that are interested in MambaLens are comparing it to the libraries listed below

• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆49Updated 2 weeks ago
• berlino / seq_icl
  ☆51Updated 10 months ago
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆47Updated 5 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated 11 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated 11 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆71Updated 11 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆62Updated this week
• sustcsonglin / linear-attention-and-beyond-slides
  ☆65Updated last month
• jiahai-feng / binding-iclr
  ☆13Updated last year
• RobertCsordas / moeut
  ☆74Updated 7 months ago
• JacobPfau / fillerTokens
  ☆60Updated 11 months ago
• Doraemonzzz / xmixers
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆11Updated 4 months ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆47Updated 3 weeks ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 10 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆25Updated last year
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆48Updated 5 months ago
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆24Updated last year
• sustcsonglin / mamba-triton
  ☆47Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• sjelassi / transformers_ssm_copy
  ☆30Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 10 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆58Updated 2 months ago
• koayon / atp_star
  PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)
  ☆18Updated 2 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆73Updated 4 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆103Updated 4 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆39Updated 11 months ago
• jbloomAus / SAEDashboard
  ☆33Updated last month
• kazuki-irie / kv-memory-brain
  Official Code Repository for the paper "Key-value memory in the brain"
  ☆24Updated last month
• jopetty / word-problem
  Experiments on the impact of depth in transformers and SSMs.
  ☆23Updated 4 months ago