Alternatives and similar repositories for heinsen_routing

Users that are interested in heinsen_routing are comparing it to the libraries listed below

• IDSIA / modern-srwm
  Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep R…
  ☆173Updated 6 months ago
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆98Updated last year
• Futrell / ziplm
  ☆255Updated 2 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆242Updated 2 years ago
• tech-srl / RASP
  An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"
  ☆323Updated last year
• lucidrains / memorizing-transformers-pytorch
  Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate …
  ☆638Updated 2 years ago
• RobertRiachi / nanoPALM
  ☆144Updated 2 years ago
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆116Updated last year
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆224Updated last year
• shawwn / ml-notes
  ☆40Updated 3 years ago
• cyrilou242 / ftcc
  Fast Text Classification with Compressors dictionary
  ☆150Updated 2 years ago
• jxbz / agd
  Automatic gradient descent
  ☆216Updated 2 years ago
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆82Updated last year
• cair / tmu
  Implements the Tsetlin Machine, Coalesced Tsetlin Machine, Convolutional Tsetlin Machine, Regression Tsetlin Machine, and Weighted Tsetli…
  ☆165Updated 4 months ago
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆521Updated 2 years ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆61Updated 3 years ago
• idoh / mamba.np
  A pure NumPy implementation of Mamba.
  ☆222Updated last year
• srush / raspy
  An interactive exploration of Transformer programming.
  ☆271Updated 2 years ago
• ExpectationMax / simple_gpu_scheduler
  Simple scheduler for running jobs on GPUs
  ☆183Updated 4 years ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆35Updated 3 years ago
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆189Updated 3 years ago
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆217Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆298Updated last year
• shawwn / jaxnotes
  ☆20Updated 4 years ago
• OswaldHe / HMT-pytorch
  [NAACL 2025] Official Implementation of "HMT: Hierarchical Memory Transformer for Long Context Language Processing"
  ☆80Updated 2 weeks ago
• nalexai / hyperlib
  Library that contains implementations of machine learning components in the hyperbolic space
  ☆144Updated last year
• lucidrains / simple-hierarchical-transformer
  Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
  ☆224Updated last year