Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
☆75Jun 23, 2020Updated 5 years ago
Alternatives and similar repositories for Linear-Multihead-Attention
Users that are interested in Linear-Multihead-Attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation for NATv2.☆23Feb 20, 2021Updated 5 years ago
- Attention mechanism☆52Sep 13, 2021Updated 4 years ago
- pytorch实现bert做seq2seq任务，使用unilm方案。☆10Apr 1, 2020Updated 6 years ago
- ☆11Apr 18, 2021Updated 5 years ago
- Multiple Anchor Learning for Visual Object Detection (CVPR,2020)☆14Mar 18, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 3 years ago
- Embedding-based Scalable Segmentation Network☆28Oct 15, 2022Updated 3 years ago
- add a Arg: label_smoothing for torch.nn.CrossEntropyLoss()☆14Jan 13, 2021Updated 5 years ago
- Generalizable Semantic Segmentation viaModel-agnostic Learning and Target-specificNormalization☆28Apr 21, 2020Updated 6 years ago
- Searching a High Performance Feature Extractor for Text Recognition Network. TPAMI 2022☆13Nov 25, 2022Updated 3 years ago
- Nonsmooth Unconstrained Optimization via Limited Memory Bundle Method☆15Mar 18, 2021Updated 5 years ago
- Wild Panoramic Panoptic Segmentation dataset☆15Jan 31, 2023Updated 3 years ago
- ☆48Feb 8, 2025Updated last year
- PyTorch implementation for HyperMixing, a linear-time token-mixing technique used in HyperMixer architecture☆26Jun 12, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This repository contains source codes for SoftCTC. Original paper can be found here: https://arxiv.org/abs/2212.02135☆19Mar 7, 2023Updated 3 years ago
- An autoregressive model for point cloud generation augmented with self-attention☆29Mar 20, 2020Updated 6 years ago
- During my research I usually like to visuallize and understand clearly how some papers/models work. In this repository I will create some…☆12Apr 7, 2022Updated 4 years ago
- Lyra: A Benchmark for Turducken-Style Code Generation☆15Apr 22, 2022Updated 4 years ago
- Code for ACL 2021 paper "Controllable Open-ended Question Generation with A New Question Type Ontology".☆14Jan 28, 2022Updated 4 years ago
- An implementation of the efficient attention module.☆329Nov 30, 2020Updated 5 years ago
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,175Feb 2, 2022Updated 4 years ago
- ☆170Oct 14, 2021Updated 4 years ago
- This repository provides UNOFFICIAL Bunched LPCNet implementations with Pytorch.☆14Jun 17, 2021Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Displaced Aggregation Units for Convolutional Networks from "Spatially-Adaptive Filter Units for Deep Neural Networks" paper☆21Apr 20, 2026Updated last month
- Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms☆20Nov 29, 2021Updated 4 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆835May 5, 2024Updated 2 years ago
- An implementation of AutoScale regression-based method☆12Oct 27, 2020Updated 5 years ago
- ☆24Nov 21, 2023Updated 2 years ago
- Localized Vision-Language Matching for Open-vocabulary Object Detection☆22Aug 11, 2022Updated 3 years ago
- Implementation of a domain adaptation neural networks on the MNIST and SVHN datasets. I implemented this repo for a technical interview f…☆19Mar 4, 2019Updated 7 years ago
- Create reliability diagrams to quantify ML calibration.☆10Feb 1, 2022Updated 4 years ago
- A Pytorch implementation of https://arxiv.org/abs/1810.12348.☆37Feb 19, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- To the best of our knowledge, this is the first work to explicitly address feature similarity issue in multi-column design. Extensive exp…☆17Jan 17, 2021Updated 5 years ago
- Pytorch library for fast transformer implementations☆1,771Mar 23, 2023Updated 3 years ago
- Unsupervised object landmark discovery @ ICCV 21☆27Feb 18, 2022Updated 4 years ago
- Android video semantic segmentation using DeeplabV3+ lite☆10Sep 20, 2019Updated 6 years ago
- ☆110Sep 15, 2021Updated 4 years ago
- ShelfNet-lightweight for paper [ShelfNet for fast semantic segmentation]☆22Dec 8, 2019Updated 6 years ago
- Scene Segmentation with Dual Relation-aware Attention Network (TNNLS2020)☆42Oct 21, 2020Updated 5 years ago