tonyduan / transformer-blocksLinks
Multi-Head Attention, Transformer, Perceiver, Linear Attention.
☆12Updated 2 years ago
Alternatives and similar repositories for transformer-blocks
Users that are interested in transformer-blocks are comparing it to the libraries listed below
Sorting:
- A differentiation API for PyTorch☆30Updated 5 years ago
- Continuous-time gradient flow for generative modeling and variational inference☆33Updated 7 years ago
- Hierarchical variational models for physics.☆18Updated 5 years ago
- Relative gradient optimization of the Jacobian term in unsupervised deep learning, NeurIPS 2020☆21Updated 4 years ago
- Code for "'Hey, that's not an ODE:' Faster ODE Adjoints via Seminorms" (ICML 2021)☆89Updated 3 years ago
- [NeurIPS 2020] Neural Manifold Ordinary Differential Equations (https://arxiv.org/abs/2006.10254)☆125Updated 2 years ago
- Jax-based MaxEnt☆17Updated 6 years ago
- Riemannian Convex Potential Maps☆67Updated 2 years ago
- ☆22Updated 5 years ago
- Library for normalizing flows and neural flows.☆26Updated 3 years ago
- Pytorch implement of the paper Neural Canonical Transformation with Symplectic Flows☆32Updated 5 years ago
- ☆70Updated 2 years ago
- Code for "Learning Unitary Operators with Help From u(n)", AAAI-17. (https://arxiv.org/abs/1607.04903)☆17Updated 9 years ago
- ☆15Updated 5 years ago
- An example showing how to use jax to train resnet50 on multi-node multi-GPU☆20Updated 3 years ago
- Code for Understanding and Mitigating Exploding Inverses in Invertible Neural Networks (AISTATS 2021) http://arxiv.org/abs/2006.09347☆30Updated 5 years ago
- ☆16Updated 7 months ago
- Experiments for the AISTATS publication on Reparameterizing Distributions over Lie Groups☆52Updated 3 years ago
- ☆50Updated 2 years ago
- Canonical normalizing flows☆10Updated 6 years ago
- ☆68Updated 3 years ago
- A Generic Tensor-Network library that is designed for quantum simulation, base on the pytorch☆59Updated 6 years ago
- Convex potential flows☆85Updated 4 years ago
- Graph Convolutional Networks in JAX☆33Updated 5 years ago
- A public repository for our paper, Rao-Blackwellized Stochastic Gradients for Discrete Distributions☆22Updated 6 years ago
- Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations☆21Updated 2 years ago
- Matrix exponential in cuda for pytorch and tensorflow☆17Updated 7 years ago
- Pytorch implementation of 'Semi-Implicit Methods for Deep Neural Networks'☆25Updated 6 years ago
- Prototypes of differentiable differential equation solvers in JAX.☆27Updated 5 years ago
- Supplementary code for the paper "Stationary Kernels and Gaussian Processes on Lie Groups and their Homogeneous Spaces"☆45Updated 2 years ago