Separius / CudaRelativeAttention
custom cuda kernel for {2, 3}d relative attention with pytorch wrapper
☆43Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for CudaRelativeAttention
- Representation learning for NLP @ JSALT19☆36Updated 4 years ago
- Online Normalization for Training Neural Networks (Companion Repository)☆79Updated 3 years ago
- "Learning Rate Dropout" in PyTorch☆34Updated 4 years ago
- Stochastic Adaptive Neural Architecture Search☆66Updated 6 years ago
- Code to accompany the paper "Hierarchical Quantized Autoencoders"☆37Updated last year
- Demos, pretrained models, and (WIP) code supporting Representation Mixing☆51Updated 5 years ago
- Python way to Read/Write TFRecords☆64Updated 6 years ago
- ☆21Updated 4 years ago
- Codes for paper <InteL-VAEs: Adding Inductive Biases to VariationalAuto-Encoders via Intermediary Latents>.☆18Updated 3 years ago
- Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch☆38Updated last year
- An implementation of shampoo☆74Updated 6 years ago
- PyTorch implementation of the paper "NanoFlow: Scalable Normalizing Flows with Sublinear Parameter Complexity." (NeurIPS 2020)☆64Updated 3 years ago
- Tensorflow Implementation of "Theory and Experiments on Vector Quantized Autoencoders"☆14Updated 5 years ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Updated last year
- Code for reproducing results in "Generative Model with Dynamic Linear Flow"☆70Updated 5 years ago
- ☆27Updated 4 years ago
- Efficient DataLoader for PyTorch and Keras for loading datasets from web servers and object stores.☆29Updated 5 years ago
- Code for experiments with our RNN regularizer, which stochastically forces units to maintain previous values.☆78Updated 7 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆36Updated 4 years ago
- A discrete sequential VAE☆38Updated 4 years ago
- Pytorch implementation of Variational Dropout Sparsifies Deep Neural Networks☆84Updated 2 years ago
- Pytorch implementation of sparse_image_warp and an example of GoogleBrain's SpecAugment is given: A Simple Data Augmentation Method for A…☆23Updated 5 years ago
- Differentiable Dynamic Programming☆69Updated 4 years ago
- A PyTorch implementation of fast-wavenet☆91Updated 6 years ago
- High performance pytorch modules☆18Updated last year
- Losses and decoders for end-to-end ASR and OCR☆33Updated 4 years ago
- Variational autoencoder implementation in tensorflow following the classic paper by Kingma and Welling.☆12Updated 7 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- Masked Convolutional Flow☆59Updated 4 years ago
- Anonymous ICLR Submission☆14Updated 5 years ago