Alternatives and similar repositories for heinsen_routing:

Users that are interested in heinsen_routing are comparing it to the libraries listed below

• IDSIA / modern-srwm
  Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep R…
  ☆170Updated last year
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆92Updated 3 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• tech-srl / RASP
  An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"
  ☆304Updated 6 months ago
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆220Updated 11 months ago
• RobertRiachi / nanoPALM
  ☆143Updated last year
• Futrell / ziplm
  ☆253Updated last year
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆81Updated 10 months ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆236Updated last year
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆218Updated 7 months ago
• lucidrains / memorizing-transformers-pytorch
  Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate …
  ☆632Updated last year
• jeffbinder / promptarray
  Text generator prompting with Boolean operators
  ☆180Updated 2 years ago
• lucidrains / simple-hierarchical-transformer
  Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
  ☆209Updated 7 months ago
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆516Updated last year
• raphaelsty / cherche
  Neural Search
  ☆327Updated 9 months ago
• cyrilou242 / ftcc
  Fast Text Classification with Compressors dictionary
  ☆151Updated last year
• jostmey / NakedAttention
  Revealing example of self-attention, the building block of transformer AI models
  ☆130Updated last year
• jxbz / agd
  Automatic gradient descent
  ☆207Updated last year
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆261Updated last year
• Dicklesworthstone / hoeffdings_d_explainer
  A Detailed Introduction to My Favorite Statistical Measure, Hoeffding's D
  ☆97Updated last year
• fullthom / chat-gpt-quine
  ☆126Updated last year
• eth-sri / language-model-arithmetic
  Controlled Text Generation via Language Model Arithmetic
  ☆216Updated 6 months ago
• OswaldHe / HMT-pytorch
  [NAACL 2025] Official Implementation of "HMT: Hierarchical Memory Transformer for Long Context Language Processing"
  ☆67Updated last month
• brohrer / sharpened-cosine-similarity
  An alternative to convolution in neural networks
  ☆254Updated 11 months ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆159Updated 10 months ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆204Updated 11 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 11 months ago
• geov-ai / geov
  The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…
  ☆121Updated last year
• Rishit-dagli / Nystromformer
  An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention
  ☆57Updated 2 years ago
• google-research / meliad
  ☆253Updated 2 years ago