awf / functional-transformerLinks
A pure-functional implementation of a machine learning transformer model in Python/JAX
☆180Updated 6 months ago
Alternatives and similar repositories for functional-transformer
Users that are interested in functional-transformer are comparing it to the libraries listed below
Sorting:
- A Pytree Module system for Deep Learning in JAX☆214Updated 2 years ago
- Named tensors with first-class dimensions for PyTorch☆331Updated 2 years ago
- ☆107Updated last year
- A functional training loops library for JAX☆88Updated last year
- ☆71Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆187Updated 3 weeks ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆259Updated 2 years ago
- ☆60Updated 3 years ago
- ☆153Updated 5 years ago
- Unofficial JAX implementations of deep learning research papers☆159Updated 3 years ago
- Framework-agnostic library for checking array/tensor shapes at runtime.☆46Updated 4 years ago
- MinT: Minimal Transformer Library and Tutorials☆259Updated 3 years ago
- An interactive exploration of Transformer programming.☆270Updated last year
- NumPy arrays, ready for human consumption☆72Updated 2 weeks ago
- Memory mapped numpy arrays of varying shapes☆304Updated last year
- Differentiable Algorithms and Algorithmic Supervision.☆116Updated 2 years ago
- An alternative to convolution in neural networks☆258Updated last year
- ☆108Updated 2 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆242Updated 2 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆115Updated 3 years ago
- A Python package of computer vision models for the Equinox ecosystem.☆109Updated last year
- JAX Synergistic Memory Inspector☆179Updated last year
- ☆159Updated last year
- PIX is an image processing library in JAX, for JAX.☆427Updated 8 months ago
- JMP is a Mixed Precision library for JAX.☆211Updated 9 months ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆131Updated 3 years ago
- Texture mapping with variational auto-encoders☆40Updated 4 years ago
- A small library for creating and manipulating custom JAX Pytree classes☆56Updated 2 years ago
- Automatic gradient descent☆215Updated 2 years ago
- Lightweight Cluster/Cloud VM Job Management 🚀☆42Updated last year