Separius / CudaRelativeAttention
custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
☆43Updated 5 years ago
Alternatives and similar repositories for CudaRelativeAttention:
Users that are interested in CudaRelativeAttention are comparing it to the libraries listed below
- Code to accompany the paper "Hierarchical Quantized Autoencoders"☆37Updated last year
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆81Updated 4 years ago
- ☆21Updated 5 years ago
- An implementation of shampoo☆74Updated 7 years ago
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆49Updated 7 years ago
- Demos, pretrained models, and (WIP) code supporting Representation Mixing☆51Updated 6 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated 2 years ago
- ☆47Updated 4 years ago
- A PyTorch implementation of fast-wavenet☆92Updated 7 years ago
- Python way to Read/Write TFRecords☆64Updated 7 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 6 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 6 years ago
- Code for reproducing results in "Generative Model with Dynamic Linear Flow"☆71Updated 5 years ago
- A discrete sequential VAE☆39Updated 5 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 5 years ago
- Code for experiments with our RNN regularizer, which stochastically forces units to maintain previous values.☆78Updated 7 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆83Updated 3 years ago
- PyTorch CTC Decoder bindings☆42Updated 7 years ago
- Differentiable Dynamic Programming☆69Updated 4 years ago
- Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"☆26Updated last year
- ☆34Updated 6 years ago
- Code in PyTorch for the convex combination linear IAF and the Householder Flow, J.M. Tomczak & M. Welling☆91Updated 7 years ago
- ☆22Updated 6 years ago
- Unofficial pytorch implementation of ReZero in ResNet☆23Updated 5 years ago
- Exploiting Uncertainty of Loss Landscape for Stochastic Optimization☆15Updated 5 years ago
- ☆62Updated 4 years ago
- Codes for paper <InteL-VAEs: Adding Inductive Biases to VariationalAuto-Encoders via Intermediary Latents>.☆19Updated 3 years ago