Implementation of Hyena Hierarchy in JAX
☆10Apr 30, 2023Updated 2 years ago
Alternatives and similar repositories for hyena-jax
Users that are interested in hyena-jax are comparing it to the libraries listed below
Sorting:
- AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning (Published in TMLR)☆23Oct 15, 2024Updated last year
- JAX/Flax implementation of the Hyena Hierarchy☆34Apr 27, 2023Updated 2 years ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Jul 11, 2023Updated 2 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- ☆29Jul 9, 2024Updated last year
- ☆13Dec 15, 2025Updated 2 months ago
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 2 years ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- ☆17Dec 19, 2024Updated last year
- a single-header math library☆17Nov 7, 2025Updated 4 months ago
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆21Nov 25, 2024Updated last year
- "PyTorch in Rust"☆17Feb 13, 2024Updated 2 years ago
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- ☆24Dec 11, 2024Updated last year
- ☆20May 30, 2024Updated last year
- ☆19Dec 4, 2025Updated 3 months ago
- Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)☆21Jun 22, 2023Updated 2 years ago
- CUDA 12.2 HMM demos☆20Jul 26, 2024Updated last year
- ☆23Jul 7, 2023Updated 2 years ago
- ☆22Dec 15, 2023Updated 2 years ago
- ☆177Apr 23, 2025Updated 10 months ago
- ☆24Sep 25, 2024Updated last year
- RADLADS training code☆37May 7, 2025Updated 10 months ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆27Oct 13, 2024Updated last year
- Checkpointable dataset utilities for foundation model training☆32Jan 29, 2024Updated 2 years ago
- ☆61Nov 27, 2023Updated 2 years ago
- Experiments on the impact of depth in transformers and SSMs.☆41Oct 23, 2025Updated 4 months ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆30Updated this week
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆67Apr 24, 2024Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32May 25, 2024Updated last year
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆33Aug 14, 2024Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- A collection of research papers on efficient training of DNNs☆69Jul 6, 2022Updated 3 years ago
- ☆35Apr 12, 2024Updated last year
- Official code repository of the paper Learning Associative Inference Using Fast Weight Memory by Schlag et al.☆29Feb 25, 2021Updated 5 years ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆34Feb 10, 2025Updated last year
- Awesome Triton Resources☆39Apr 27, 2025Updated 10 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Dec 2, 2023Updated 2 years ago