Alternatives and similar repositories for hyena-jax

Users that are interested in hyena-jax are comparing it to the libraries listed below

• subho406 / agalite

  View on GitHub
  AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)
  ☆23Oct 15, 2024Updated last year
• irhum / hyena

  View on GitHub
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Apr 27, 2023Updated 2 years ago
• Yuanhy1997 / HyPe

  View on GitHub
  HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]
  ☆14Jul 11, 2023Updated 2 years ago
• Doraemonzzz / nanoTransNormer

  View on GitHub
  ☆11Oct 11, 2023Updated 2 years ago
• Doraemonzzz / hgru-pytorch

  View on GitHub
  ☆29Jul 9, 2024Updated last year
• samblouir / birdie

  View on GitHub
  ☆13Dec 15, 2025Updated 2 months ago
• OpenNLPLab / ETSC-Exact-Toeplitz-to-SSM-Conversion

  View on GitHub
  [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…
  ☆14Oct 17, 2023Updated 2 years ago
• TiledTensor / TiledBench

  View on GitHub
  Benchmark tests supporting the TiledCUDA library.
  ☆18Nov 19, 2024Updated last year
• AlirezaMorsali / MLP-Attention

  View on GitHub
  ☆16Dec 19, 2024Updated last year
• herrmann / rustorch

  View on GitHub
  "PyTorch in Rust"
  ☆17Feb 13, 2024Updated 2 years ago
• frozein / QuickMathHPP

  View on GitHub
  a single-header math library
  ☆17Nov 7, 2025Updated 3 months ago
• lucas-maes / nano-simsiam

  View on GitHub
  Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…
  ☆21Nov 25, 2024Updated last year
• EleutherAI / training-jacobian

  View on GitHub
  ☆24Dec 11, 2024Updated last year
• proger / nanokitchen

  View on GitHub
  Parallel Associative Scan for Language Models
  ☆18Jan 8, 2024Updated 2 years ago
• yikangshen / megablocks

  View on GitHub
  ☆20May 30, 2024Updated last year
• davisyoshida / abnormal-floats

  View on GitHub
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆21Jun 22, 2023Updated 2 years ago
• ethansmith2000 / TransformerExperiments

  View on GitHub
  ☆19Dec 4, 2025Updated 2 months ago
• NVIDIA / HMM_sample_code

  View on GitHub
  CUDA 12.2 HMM demos
  ☆20Jul 26, 2024Updated last year
• sanagno / adaptively_sparse_attention

  View on GitHub
  ☆22Jul 7, 2023Updated 2 years ago
• Aleph-Alpha-Research / NeurIPS-WANT-submission-efficient-parallelization-layouts

  View on GitHub
  ☆22Dec 15, 2023Updated 2 years ago
• codefuse-ai / rodimus

  View on GitHub
  ☆177Apr 23, 2025Updated 9 months ago
• recursal / RADLADS-paper

  View on GitHub
  RADLADS training code
  ☆37May 7, 2025Updated 9 months ago
• Doraemonzzz / hgru2-pytorch

  View on GitHub
  ☆24Sep 25, 2024Updated last year
• glassroom / heinsen_attention

  View on GitHub
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Jun 6, 2024Updated last year
• iwiwi / epochraft

  View on GitHub
  Checkpointable dataset utilities for foundation model training
  ☆32Jan 29, 2024Updated 2 years ago
• Lin-Mao / DrGPUM

  View on GitHub
  A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
  ☆27Oct 13, 2024Updated last year
• jopetty / word-problem

  View on GitHub
  Experiments on the impact of depth in transformers and SSMs.
  ☆40Oct 23, 2025Updated 3 months ago
• tridao / flash-attention-wheels

  View on GitHub
  ☆61Nov 27, 2023Updated 2 years ago
• habanero-lab / APPy

  View on GitHub
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆30Jan 28, 2026Updated 2 weeks ago
• OpenNLPLab / HGRN

  View on GitHub
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆67Apr 24, 2024Updated last year
• nanowell / Q-Sparse-LLM

  View on GitHub
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Aug 14, 2024Updated last year
• GindaChen / FlexFlashAttention3

  View on GitHub
  FlexAttention w/ FlashAttention3 Support
  ☆27Oct 5, 2024Updated last year
• EleutherAI / rnngineering

  View on GitHub
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32May 25, 2024Updated last year
• jmluu / Awesome-Efficient-Training

  View on GitHub
  A collection of research papers on efficient training of DNNs
  ☆70Jul 6, 2022Updated 3 years ago
• google-deepmind / spectral_ssm

  View on GitHub
  ☆35Apr 12, 2024Updated last year
• Doraemonzzz / Awesome-Triton-Resources

  View on GitHub
  Awesome Triton Resources
  ☆39Apr 27, 2025Updated 9 months ago
• sjtu-epcc / Tacker

  View on GitHub
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆34Feb 10, 2025Updated last year
• ischlag / Fast-Weight-Memory-public

  View on GitHub
  Official code repository of the paper Learning Associative Inference Using Fast Weight Memory by Schlag et al.
  ☆29Feb 25, 2021Updated 4 years ago
• dame-cell / Triformer

  View on GitHub
  Transformers components but in Triton
  ☆34May 9, 2025Updated 9 months ago