davisyoshida / haiku-mupView external linksLinks
A port of muP to JAX/Haiku
☆25Oct 23, 2022Updated 3 years ago
Alternatives and similar repositories for haiku-mup
Users that are interested in haiku-mup are comparing it to the libraries listed below
Sorting:
- ☆18Aug 24, 2024Updated last year
- Code for the NLP4Prog workshop paper "Reading StackOverflow Encourages Cheating: Adding Question TextImproves Extractive Code Generation"☆21Aug 10, 2021Updated 4 years ago
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- High-performance tokenized language data-loader for Python C++ extension☆14Jul 22, 2024Updated last year
- ☆13Dec 15, 2025Updated 2 months ago
- nanoGPT using Equinox☆15Mar 3, 2023Updated 2 years ago
- [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆14Mar 18, 2025Updated 10 months ago
- Unofficial JAX implementation of the SOAP optimizer (https://arxiv.org/abs/2409.11321)☆24Jan 9, 2026Updated last month
- Schedule free optimiser implemented in JAX using Optimistix☆15May 29, 2024Updated last year
- Dreamer on JAX☆16Jan 19, 2022Updated 4 years ago
- The accompanying code for "Exploring the limits of decoder-only models trained on public speech recognition corpora" (Ankit Gupta, George…☆20Oct 11, 2024Updated last year
- A simple implementation of Hamiltonian Monte Carlo in JAX.☆20Feb 8, 2024Updated 2 years ago
- A JAX nn library☆22Sep 9, 2025Updated 5 months ago
- Code for the paper "Function-Space Learning Rates"☆25Jun 3, 2025Updated 8 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆93Jan 25, 2024Updated 2 years ago
- GPT2 Byte Pair Encoding implementation in Golang☆24Jul 9, 2025Updated 7 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆23Aug 18, 2024Updated last year
- ☆23Jun 18, 2024Updated last year
- Experiments on the impact of depth in transformers and SSMs.☆40Oct 23, 2025Updated 3 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 8 months ago
- An annotated implementation of the Hyena Hierarchy paper☆34May 28, 2023Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32May 25, 2024Updated last year
- [ICLR 2025] SDTT: a simple and effective distillation method for discrete diffusion models☆47Sep 10, 2025Updated 5 months ago
- ☆28Nov 18, 2022Updated 3 years ago
- ☆35Apr 12, 2024Updated last year
- Exponential families for JAX☆76Feb 1, 2026Updated 2 weeks ago
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆10Jul 19, 2024Updated last year
- A python algorithm to change the pitch of the voice in real time☆13Dec 13, 2020Updated 5 years ago
- Einsum-like high-level array sharding API for JAX☆34Jul 16, 2024Updated last year
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆54Jan 12, 2026Updated last month
- Linear Attention Sequence Parallelism (LASP)☆88Jun 4, 2024Updated last year
- ☆42Jun 19, 2024Updated last year
- ☆16Jul 23, 2023Updated 2 years ago
- A fine-mapping method integrating GWAS summary statistics and functional annotation data☆11Dec 28, 2023Updated 2 years ago
- (READ ONLY MIRROR) The ProB Model Checker and Animator Plugin for Rodin☆19Jan 24, 2026Updated 3 weeks ago
- ☆35Mar 25, 2024Updated last year
- CVPR 2023: PAniC-3D, Vtubers dataset downloader☆13Apr 22, 2023Updated 2 years ago
- ☆42May 18, 2020Updated 5 years ago
- Implementations of the renormalization group-based diffusion model (RGDM).☆16Mar 10, 2025Updated 11 months ago