Separius / CudaRelativeAttentionLinks
custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
☆43Updated 5 years ago
Alternatives and similar repositories for CudaRelativeAttention
Users that are interested in CudaRelativeAttention are comparing it to the libraries listed below
Sorting:
- Code to accompany the paper "Hierarchical Quantized Autoencoders"☆37Updated last year
- A PyTorch implementation of fast-wavenet☆93Updated 7 years ago
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- Code for reproducing results in "Generative Model with Dynamic Linear Flow"☆71Updated 6 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 5 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆83Updated 4 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆83Updated 3 years ago
- Python way to Read/Write TFRecords☆64Updated 7 years ago
- An implementation of shampoo☆77Updated 7 years ago
- PyTorch implementation of the paper "NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity." (NeurIPS 2020)☆66Updated 4 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 6 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- Demos, pretrained models, and (WIP) code supporting Representation Mixing☆51Updated 6 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 6 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆44Updated 5 years ago
- Simple implementation of the LSUV initialization in PyTorch☆58Updated last year
- A discrete sequential VAE☆40Updated 5 years ago
- ☆62Updated 5 years ago
- ☆22Updated 5 years ago
- Implementation of "Variational Dropout and the Local Reparameterization Trick" paper with Pytorch☆49Updated 7 years ago
- Implementation of the reversible residual network in pytorch☆105Updated 3 years ago
- ☆27Updated 6 years ago
- ☆40Updated 7 years ago
- PyTorch Examples repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆61Updated last year
- Levenshtein edit-distance on PyTorch and CUDA☆95Updated 2 years ago
- PyTorch Implementations of Dropout Variants☆87Updated 7 years ago
- ☆22Updated 6 years ago
- Differentiable Dynamic Programming☆70Updated 4 years ago
- ☆27Updated 5 years ago
- A PyTorch implementation of the VQ-VAE-2 paper☆75Updated 5 years ago