☆62Dec 8, 2023Updated 2 years ago
Alternatives and similar repositories for StripedHyenaTrainer
Users that are interested in StripedHyenaTrainer are comparing it to the libraries listed below
Sorting:
- Repository for StripedHyena, a state-of-the-art beyond Transformer architecture☆411Mar 7, 2024Updated last year
- High-performance tokenized language data-loader for Python C++ extension☆14Jul 22, 2024Updated last year
- ☆13Dec 15, 2025Updated 2 months ago
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Aug 29, 2023Updated 2 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated last year
- Experiments on the impact of depth in transformers and SSMs.☆40Oct 23, 2025Updated 4 months ago
- An annotated implementation of the Hyena Hierarchy paper☆34May 28, 2023Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32May 25, 2024Updated last year
- Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021☆29Sep 25, 2021Updated 4 years ago
- ☆35Apr 12, 2024Updated last year
- ☆20May 30, 2024Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆138Dec 17, 2024Updated last year
- JAX/Flax implementation of the Hyena Hierarchy☆34Apr 27, 2023Updated 2 years ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆21Jul 29, 2024Updated last year
- A bot for automatically completing the KAIST safety course☆10Aug 29, 2023Updated 2 years ago
- papers.day☆93Dec 15, 2023Updated 2 years ago
- Convolutions for Sequence Modeling☆913Jun 13, 2024Updated last year
- Understand and test language model architectures on synthetic tasks.☆257Feb 24, 2026Updated last week
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆12Mar 11, 2024Updated last year
- A creative coding environment where Claude can express itself through generative art using p5.js. See tweet thread for examples: https://…☆13Feb 3, 2026Updated last month
- Drastically Reducing the Number of Trainable Parameters in Deep CNNs by Inter-layer Kernel-sharing☆14Mar 28, 2023Updated 2 years ago
- ☆12Jan 29, 2021Updated 5 years ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Nov 11, 2024Updated last year
- an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf☆11Jul 25, 2023Updated 2 years ago
- ☆11Apr 14, 2022Updated 3 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- 🐣🕐📅 A simple utility to draft scheduling emails.☆12Sep 13, 2023Updated 2 years ago
- Fine-tune copilot based on your codebase☆12Mar 26, 2024Updated last year
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆12May 24, 2023Updated 2 years ago
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 2 years ago
- Official repository for the paper: "Trees with Attention for Set Prediction Tasks" (ICML21)☆10Jan 19, 2022Updated 4 years ago
- ☆29Nov 30, 2021Updated 4 years ago
- ☆29Jul 9, 2024Updated last year
- ☆12Mar 7, 2022Updated 3 years ago
- ☆12May 28, 2025Updated 9 months ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated last year
- ☆58Jul 9, 2024Updated last year
- HGRN2: Gated Linear RNNs with State Expansion☆56Aug 20, 2024Updated last year
- Examples of apps built with Nendo, the AI Audio Tool Suite☆55Feb 29, 2024Updated 2 years ago