Separius / CudaRelativeAttention
custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
☆43Updated 4 years ago
Alternatives and similar repositories for CudaRelativeAttention:
Users that are interested in CudaRelativeAttention are comparing it to the libraries listed below
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 5 years ago
- Demos, pretrained models, and (WIP) code supporting Representation Mixing☆51Updated 6 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 5 years ago
- ☆21Updated 4 years ago
- PyTorch implementation of the paper "NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity." (NeurIPS 2020)☆64Updated 4 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated last year
- An implementation of shampoo☆74Updated 6 years ago
- Codes for paper <InteL-VAEs: Adding Inductive Biases to VariationalAuto-Encoders via Intermediary Latents>.☆19Updated 3 years ago
- Python way to Read/Write TFRecords☆64Updated 6 years ago
- Code for "MIM: Mutual Information Machine" paper.☆16Updated 2 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆50Updated 7 years ago
- Code to accompany the paper "Hierarchical Quantized Autoencoders"☆37Updated last year
- "Learning Discrete and Continuous Factors of Data via Alternating Disentanglement" accepted at ICML2019☆21Updated 5 years ago
- PyTorch CTC Decoder bindings☆42Updated 7 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆84Updated 3 years ago
- A discrete sequential VAE☆39Updated 4 years ago
- Pytorch implementation of sparse_image_warp and an example of GoogleBrain's SpecAugment is given: A Simple Data Augmentation Method for A…☆23Updated 5 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆79Updated 3 years ago
- ☆47Updated 4 years ago
- PyTorch bindings for Warp-CTC☆42Updated 5 years ago
- ☆27Updated 4 years ago
- Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"☆25Updated last year
- Code for reproducing results in "Generative Model with Dynamic Linear Flow"☆70Updated 5 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆62Updated 6 months ago
- Run Pytorch graphs inside Theano graph (and pytorch wrapper for AIS for generative models).☆18Updated 7 years ago
- ☆22Updated 6 years ago
- BIVA: A Very Deep Hierarchy of Latent Variables forGenerative Modeling☆29Updated 5 years ago