Separius / awesome-fast-attentionLinks
list of efficient attention modules
☆1,012Updated 4 years ago
Alternatives and similar repositories for awesome-fast-attention
Users that are interested in awesome-fast-attention are comparing it to the libraries listed below
Sorting:
- Some tricks of pytorch...☆1,195Updated last year
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,109Updated 2 years ago
- A comprehensive list of awesome contrastive self-supervised learning papers.☆1,286Updated 11 months ago
- label-smooth, amsoftmax, partial-fc, focal-loss, triplet-loss, lovasz-softmax. Maybe useful☆2,248Updated 10 months ago
- A quickstart and benchmark for pytorch distributed training.☆1,668Updated last year
- PyTorch implementation of Contrastive Learning methods☆1,987Updated last year
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆990Updated 10 months ago
- A curated list of Multimodal Related Research.☆1,368Updated 2 years ago
- A PyTorch Implementation of Focal Loss.☆985Updated 5 years ago
- A curated list of resources for Learning with Noisy Labels☆2,700Updated 3 months ago
- My best practice of training large dataset using PyTorch.☆1,101Updated last year
- Debug PyTorch code using PySnooper☆797Updated 4 years ago
- knowledge distillation papers☆758Updated 2 years ago
- some tircks for PyTorch☆576Updated 5 years ago
- 😎 An up-to-date & curated list of awesome semi-supervised learning papers, methods & resources.☆1,849Updated last year
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,623Updated 2 years ago
- FSL-Mate: A collection of resources for few-shot learning (FSL).☆1,750Updated last month
- This repository contains code for the paper "Decoupling Representation and Classifier for Long-Tailed Recognition", published at ICLR 202…☆975Updated 3 years ago
- Unofficial implementation of: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics☆556Updated 3 years ago
- pytorch memory track code☆1,018Updated 4 years ago
- Collection for Few-shot Learning☆984Updated 2 years ago
- A list of multi-task learning papers and projects.☆381Updated 3 years ago
- [arXiv 2019] "Contrastive Multiview Coding", also contains implementations for MoCo and InstDis☆1,326Updated 4 years ago
- [ICLR 2020] Lite Transformer with Long-Short Range Attention☆611Updated last year
- [NeurIPS 2020] Semi-Supervision (Unlabeled Data) & Self-Supervision Improve Class-Imbalanced / Long-Tailed Learning☆758Updated 4 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,180Updated 2 years ago
- A multi-task learning example for the paper https://arxiv.org/abs/1705.07115☆864Updated 5 years ago
- Pytorch implementation of the paper "Class-Balanced Loss Based on Effective Number of Samples"☆800Updated last year
- Sublinear memory optimization for deep learning. https://arxiv.org/abs/1604.06174☆600Updated 5 years ago
- A curated list of papers, code and resources pertaining to zero shot learning☆929Updated 4 years ago