This is the public github for our paper "Transformer with a Mixture of Gaussian Keys"
☆28Aug 13, 2022Updated 3 years ago
Alternatives and similar repositories for transformer-mgk
Users that are interested in transformer-mgk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A novel variant of sliced Wasserstein based on a new slicing technique that utilizes the convolution operator.☆12Jan 14, 2023Updated 3 years ago
- A PyTorch Implementation of the Luna: Linear Unified Nested Attention☆41Jul 29, 2021Updated 4 years ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- Do input gradients highlight discriminative features? [NeurIPS 2021] (https://arxiv.org/abs/2102.12781)☆12Jan 10, 2023Updated 3 years ago
- Sparse Attention with Linear Units☆20Apr 21, 2021Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [EMNLP 2023] Official implementation of the algorithm ETSC: Exact Toeplitz-to-SSM Conversion our EMNLP 2023 paper - Accelerating Toeplitz…☆14Oct 17, 2023Updated 2 years ago
- This is an implementation of Graph Convolution Topic Model for Data Streams☆15Sep 12, 2022Updated 3 years ago
- Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)☆48Jan 6, 2026Updated 3 months ago
- Official PyTorch implementation for paper: Energy-Based Sliced Wasserstein Distance☆18Feb 21, 2025Updated last year
- ☆15Jan 26, 2023Updated 3 years ago
- Single-Source Domain Generalization for Bearing Fault Diagnosis Using Feature-Augmented Adaptive Neuro-Fuzzy Inference System☆11Apr 13, 2024Updated 2 years ago
- A trained neural network built from scratch to classify clothes and digits from the MNIST dataset☆14Sep 11, 2019Updated 6 years ago
- Transformer-based Label Set Generation for Multi-modal Multi-label Emotion Detection☆14Dec 16, 2021Updated 4 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Our paper is titled "NUS-IDS at FinCausal 2021: Dependency Tree in Graph Neural Networks for better Cause-Effect Span Detection".☆13Feb 11, 2022Updated 4 years ago
- Dynamic mode decomposition in Python☆13Jun 9, 2015Updated 10 years ago
- Implementation of ICML 22 Paper: Scaling Structured Inference with Randomization☆13Jul 24, 2022Updated 3 years ago
- LEAP is a novel tool for discovering latent temporal causal relations.☆17Oct 18, 2021Updated 4 years ago
- Explorations into the recently proposed Taylor Series Linear Attention☆100Aug 18, 2024Updated last year
- Mixture of Attention Heads☆52Oct 10, 2022Updated 3 years ago
- Bayesian Attention Modules☆37Dec 14, 2020Updated 5 years ago
- WavSpA: Wavelet Space Attention for Enhancing Transformer's Long Sequence Learning☆12Feb 24, 2024Updated 2 years ago
- The source code (Pytorch version) of paper "Multi-modality augmented Prototypical Network for Fault Diagnosis"☆11Aug 26, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆61Apr 19, 2022Updated 3 years ago
- Multi-modal Multi-label Emotion Recognition with Heterogeneous Hierarchical Message Passing☆18Sep 24, 2022Updated 3 years ago
- General API for Deep Bayesian Variational Inference by Backpropagation. The repository has been designed to work with Transformers like a…☆45Sep 23, 2020Updated 5 years ago
- Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"☆16Aug 11, 2023Updated 2 years ago
- ☆17May 13, 2025Updated 11 months ago
- HyperBCS: Biscale Convolutional Self-Attention Network for Hyperspectral Coastal Wetlands Classification☆12May 9, 2025Updated 11 months ago
- [AAAI 2025] Official Implementation of "HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecasting"☆17Feb 17, 2025Updated last year
- add a Arg: label_smoothing for torch.nn.CrossEntropyLoss()☆14Jan 13, 2021Updated 5 years ago
- Official repository of the paper Face Presentation Attack Detection by Eacavating Causal Clues and Adapting Embedding Statistics☆14Aug 29, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Mar 31, 2022Updated 4 years ago
- ☆21Oct 6, 2021Updated 4 years ago
- ☆13Oct 15, 2022Updated 3 years ago
- ☆24Aug 2, 2022Updated 3 years ago
- A package containing neural network architectures based on Variational Autoencoders (VAE) and Restricted Boltzmann Machines (RBM) for lea…☆12Dec 23, 2021Updated 4 years ago
- Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference☆14Jul 6, 2020Updated 5 years ago
- ☆25Apr 16, 2025Updated last year