awf / functional-transformer
A pure-functional implementation of a machine learning transformer model in Python/JAX
☆179Updated last week
Alternatives and similar repositories for functional-transformer
Users that are interested in functional-transformer are comparing it to the libraries listed below
Sorting:
- Named tensors with first-class dimensions for PyTorch☆320Updated last year
- A Pytree Module system for Deep Learning in JAX☆214Updated 2 years ago
- ☆103Updated 10 months ago
- A functional training loops library for JAX☆88Updated last year
- ☆67Updated last year
- ☆153Updated 4 years ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆258Updated last year
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆127Updated 2 years ago
- JAX Synergistic Memory Inspector☆173Updated 9 months ago
- JAX Arrays for human consumption☆92Updated last year
- A Python package of computer vision models for the Equinox ecosystem.☆103Updated 9 months ago
- MinT: Minimal Transformer Library and Tutorials☆254Updated 2 years ago
- Unofficial JAX implementations of deep learning research papers☆156Updated 2 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆239Updated 2 years ago
- Running Jax in PyTorch Lightning☆100Updated 4 months ago
- A library to inspect and extract intermediate layers of PyTorch models.☆472Updated 3 years ago
- Memory mapped numpy arrays of varying shapes☆298Updated 10 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆174Updated this week
- Annotating tensor shapes using Python types☆159Updated last year
- NumPy arrays, ready for human consumption☆69Updated 9 months ago
- ☆108Updated 2 years ago
- Silly twitter torch implementations.☆46Updated 2 years ago
- Differentiable Algorithms and Algorithmic Supervision.☆115Updated last year
- Framework-agnostic library for checking array/tensor shapes at runtime.☆46Updated 4 years ago
- An interactive exploration of Transformer programming.☆263Updated last year
- ☆60Updated 3 years ago
- JMP is a Mixed Precision library for JAX.☆198Updated 3 months ago
- Python Research Framework☆106Updated 2 years ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆187Updated 2 years ago
- ☆156Updated last year