This is the public github for our paper "Transformer with a Mixture of Gaussian Keys"
☆29Aug 13, 2022Updated 4 years ago
Alternatives and similar repositories for transformer-mgk
Users that are interested in transformer-mgk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Text Query based Traffic Video Event Retrieval with Global-Local Fusion Embedding☆13Aug 2, 2023Updated 3 years ago
- ☆16Dec 21, 2023Updated 2 years ago
- Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)☆61Apr 19, 2022Updated 4 years ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆20Oct 9, 2022Updated 4 years ago
- Source code for a LoRA-based continual relation extraction method.☆14Sep 25, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Do input gradients highlight discriminative features? [NeurIPS 2021] (https://arxiv.org/abs/2102.12781)☆12Jan 10, 2023Updated 3 years ago
- This is an implementation of Graph Convolution Topic Model for Data Streams☆15Sep 12, 2022Updated 4 years ago
- ☆16Dec 9, 2023Updated 2 years ago
- A probabilitic model for contextual word representation. Accepted to ACL2023 Findings.☆25Oct 22, 2023Updated 3 years ago
- ☆26May 30, 2023Updated 3 years ago
- Sparse Attention with Linear Units☆20Apr 21, 2021Updated 5 years ago
- ☆26Nov 23, 2023Updated 2 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- Single-Source Domain Generalization for Bearing Fault Diagnosis Using Feature-Augmented Adaptive Neuro-Fuzzy Inference System☆13Apr 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Jan 26, 2023Updated 3 years ago
- Implementation of ICML 22 Paper: Scaling Structured Inference with Randomization☆13Jul 24, 2022Updated 4 years ago
- Dynamic mode decomposition in Python☆13Jun 9, 2015Updated 11 years ago
- This is a simple example for face verification using facenet implemented by davidsandberg☆10Apr 28, 2019Updated 7 years ago
- Pseudo-labeling for tabular data☆24Feb 11, 2026Updated 8 months ago
- Project for SNARE benchmark☆11Jun 5, 2024Updated 2 years ago
- Flow Matching Tutorial☆15May 22, 2026Updated 5 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆102Aug 27, 2026Updated 2 months ago
- Code for ACL 2022 findings paper "Gaussian Multi-head Attention for Simultaneous Machine Translation"☆11Mar 31, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- On the forward invariance of Neural ODEs: performance guarantees for policy learning☆11Aug 27, 2024Updated 2 years ago
- Our paper is titled "NUS-IDS at FinCausal 2021: Dependency Tree in Graph Neural Networks for better Cause-Effect Span Detection".☆13Feb 11, 2022Updated 4 years ago
- Robust Benchmark MS-COCO to Stress-test Robustness of Image-Text Matching Models☆11Nov 9, 2024Updated last year
- Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"☆16Nov 11, 2024Updated last year
- General API for Deep Bayesian Variational Inference by Backpropagation. The repository has been designed to work with Transformers like a…☆44Sep 23, 2020Updated 6 years ago
- GPT Demo with hybrid distributed training☆10Dec 1, 2022Updated 3 years ago
- CMU Linguistic Annotation Backend☆15Sep 22, 2025Updated last year
- ☆28Oct 21, 2019Updated 7 years ago
- ☆11May 27, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Nov 26, 2022Updated 3 years ago
- Author's implementation of the paper: "Deep Attentive Variational Inference", ICLR 2022.☆10Jun 7, 2022Updated 4 years ago
- Mixture of Attention Heads☆54Oct 10, 2022Updated 4 years ago
- ☆16Oct 16, 2024Updated 2 years ago
- Prabhupadavani: A Code-mixed Speech Translation Data for 25 languages☆14Oct 12, 2022Updated 4 years ago
- Active Inference for Stochastic Control☆10Aug 30, 2021Updated 5 years ago
- Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"☆34Nov 29, 2023Updated 2 years ago