Utilities for Training Very Large Models
☆58Sep 25, 2024Updated last year
Alternatives and similar repositories for fmengine
Users that are interested in fmengine are comparing it to the libraries listed below
Sorting:
- A chat implementation for FastHTML☆11Sep 14, 2025Updated 5 months ago
- ☆20Jul 12, 2023Updated 2 years ago
- Utilities for PyTorch distributed☆25Feb 27, 2025Updated last year
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- ☆19Dec 4, 2025Updated 2 months ago
- Re-implementation of local descriptor HardNet training in fasta2+kornia☆21Apr 6, 2020Updated 5 years ago
- ☆21Mar 3, 2025Updated 11 months ago
- ☆52Jun 10, 2024Updated last year
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 2 years ago
- ☆11Oct 11, 2023Updated 2 years ago
- Optimized primitives for collective multi-GPU communication☆10May 8, 2024Updated last year
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆12Aug 15, 2024Updated last year
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆11Mar 18, 2023Updated 2 years ago
- This is not remotely close to a finished product, and does not intend to nor does this claim to be working fine-tuning code for MaskGCT. …☆13Dec 4, 2024Updated last year
- ☆27Aug 25, 2023Updated 2 years ago
- Checkpointable dataset utilities for foundation model training☆32Jan 29, 2024Updated 2 years ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 8 months ago
- Python tools☆14Oct 22, 2023Updated 2 years ago
- ☆13Dec 15, 2025Updated 2 months ago
- ☆18Apr 3, 2023Updated 2 years ago
- A 20M RWKV v6 can do nonogram☆14Oct 18, 2024Updated last year
- ☆48Aug 29, 2024Updated last year
- ☆15Jul 13, 2025Updated 7 months ago
- Build modern UIs in Jupyter with Python☆12Dec 28, 2022Updated 3 years ago
- RWKV6 in native pytorch and triton:)☆11Aug 4, 2024Updated last year
- ☆12Jan 4, 2024Updated 2 years ago
- Experiment of using Tangent to autodiff triton☆82Jan 22, 2024Updated 2 years ago
- Experiments for handwriting recognition☆14Aug 25, 2020Updated 5 years ago
- Using Fastai library to classify Twitter jokes in Spanish☆12Jul 4, 2019Updated 6 years ago
- Interpretability analysis of language model outlier and attempts to distill the model☆13May 8, 2023Updated 2 years ago
- ☆11Dec 12, 2019Updated 6 years ago
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 2 years ago
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 2 years ago
- ☆14Oct 18, 2023Updated 2 years ago
- ☆34Sep 10, 2024Updated last year
- A toolkit for scaling law research ⚖☆57Jan 27, 2025Updated last year
- A repository for research on medium sized language models.☆533Jun 6, 2025Updated 8 months ago
- ☆19Aug 10, 2024Updated last year
- ☆17Dec 19, 2024Updated last year