thuml / Flowformer
About Code release for "Flowformer: Linearizing Transformers with Conservation Flows" (ICML 2022), https://arxiv.org/pdf/2202.06258.pdf
☆317Updated 9 months ago
Alternatives and similar repositories for Flowformer:
Users that are interested in Flowformer are comparing it to the libraries listed below
- [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention☆190Updated 2 years ago
- Source code of ICML'22 paper: FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting☆208Updated 2 years ago
- ☆283Updated 2 years ago
- [CVPR 2022 Oral] Balanced MSE for Imbalanced Visual Regression https://arxiv.org/abs/2203.16427☆383Updated 2 years ago
- The official code for the paper: https://openreview.net/forum?id=_PHymLIxuI☆384Updated last year
- Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"☆361Updated last year
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆755Updated 11 months ago
- Code release for "LogME: Practical Assessment of Pre-trained Models for Transfer Learning" (ICML 2021) and Ranking and Tuning Pre-trained…☆209Updated last year
- Official PyTorch implementation for the paper "CARD: Classification and Regression Diffusion Models"☆226Updated 2 years ago
- [NeurIPS 2021] [T-PAMI] Global Filter Networks for Image Classification☆474Updated last year
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆183Updated 2 years ago
- CVPR2022, BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning, https://arxiv.org/abs/2203.01522☆251Updated last year
- Self-supervised contrastive learning for time series via time-frequency consistency☆468Updated 11 months ago
- About Code release for "SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modeling" (NeurIPS 2023 Spotlight), https://arxiv.…☆126Updated 11 months ago
- PyTorch code for CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecasting (ICLR 2022)☆223Updated 2 years ago
- Source code of NeurIPS'22 paper: FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting☆33Updated 2 years ago
- Implementation of Linformer for Pytorch☆279Updated last year
- RevIN: Reversible Instance Normalization For Accurate Time-series Forecasting Against Distribution Shift☆336Updated 7 months ago
- iFormer: Inception Transformer☆245Updated 2 years ago
- An implementation of local windowed attention for language modeling☆440Updated 3 months ago
- An implementation of the efficient attention module.☆306Updated 4 years ago
- This is an official implementation code for paper "A Survey on Time-Series Pre-Trained Models" (TKDE-24).☆175Updated 6 months ago
- FITS: Frequency Interpolation Time Series Analysis Baseline☆176Updated 4 months ago
- ☆708Updated last year
- About code release of "Interpretable Weather Forecasting for Worldwide Stations with a Unified Deep Model", Nature Machine Intelligence, …☆175Updated 3 months ago
- Code release of paper "MICN: Multi-scale Local and Global Context Modeling for Long-term Series Forecasting" (ICLR 2023)☆112Updated 2 years ago
- Pytorch implementation of the GradNorm. GradNorm addresses the problem of balancing multiple losses for multi-task learning by learning a…☆263Updated 2 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆115Updated 2 years ago
- [IJCAI-21] "Time-Series Representation Learning via Temporal and Contextual Contrasting"☆414Updated last year
- Multi-task learning using uncertainty to weigh losses for scene geometry and semantics, Auxiliary Tasks in Multi-task Learning☆612Updated 4 years ago