Separius / CudaRelativeAttention
custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
☆43Updated 4 years ago
Alternatives and similar repositories for CudaRelativeAttention:
Users that are interested in CudaRelativeAttention are comparing it to the libraries listed below
- Code to accompany the paper "Hierarchical Quantized Autoencoders"☆37Updated last year
- Representation learning for NLP @ JSALT19☆38Updated 4 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 6 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 5 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆81Updated 3 years ago
- Demos, pretrained models, and (WIP) code supporting Representation Mixing☆51Updated 6 years ago
- Code for reproducing results in "Generative Model with Dynamic Linear Flow"☆70Updated 5 years ago
- An implementation of shampoo☆74Updated 7 years ago
- PyTorch implementation of the paper "NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity." (NeurIPS 2020)☆65Updated 4 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- High performance pytorch modules☆18Updated 2 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- ☆21Updated 5 years ago
- Code for ICLR 2021 Paper, "Anytime Sampling for Autoregressive Models via Ordered Autoencoding"☆26Updated last year
- ☆62Updated 4 years ago
- ☆27Updated 4 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated 2 years ago
- "Learning Discrete and Continuous Factors of Data via Alternating Disentanglement" accepted at ICML2019☆21Updated 5 years ago
- Code for experiments with our RNN regularizer, which stochastically forces units to maintain previous values.☆78Updated 7 years ago
- Python way to Read/Write TFRecords☆64Updated 6 years ago
- ☆47Updated 4 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 6 years ago
- Code for "MIM: Mutual Information Machine" paper.☆16Updated 2 years ago
- ☆16Updated 3 years ago
- VAE + Quantile Networks for MNIST☆12Updated 6 years ago
- A discrete sequential VAE☆39Updated 4 years ago
- Efficient DataLoader for PyTorch and Keras for loading datasets from web servers and object stores.☆29Updated 5 years ago
- Codes for paper <InteL-VAEs: Adding Inductive Biases to VariationalAuto-Encoders via Intermediary Latents>.☆19Updated 3 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 5 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Updated 4 years ago