kyegomez / DifferentialTransformerLinks
An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.
☆38Updated last week
Alternatives and similar repositories for DifferentialTransformer
Users that are interested in DifferentialTransformer are comparing it to the libraries listed below
Sorting:
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆86Updated last year
- ☆257Updated 3 months ago
- RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Tasks☆122Updated last year
- ☆140Updated last year
- Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"☆118Updated this week
- Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…☆136Updated 3 weeks ago
- Minimal Mamba-2 implementation in PyTorch☆242Updated last year
- Efficient Python library for Extended LSTM with exponential gating, memory mixing, and matrix memory for superior sequence modeling.☆303Updated last year
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆56Updated 3 months ago
- 🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)☆75Updated last year
- tinybig for deep function learning☆60Updated 8 months ago
- Simba☆217Updated last year
- Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)☆29Updated 2 weeks ago
- Semantics-Aware Patch Encoding and Hierarchical Dependency Modeling for Long-Term Time Series Forecasting☆49Updated 6 months ago
- The code of CIKM'25 paper: "SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting"☆218Updated 2 months ago
- Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports☆91Updated last year
- Pytorch implementation of the xLSTM model by Beck et al. (2024)☆181Updated last year
- ☆93Updated 11 months ago
- Official repository for CVPR24 Precognition Workshop Paper: VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotem…☆159Updated last year
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆213Updated last week
- Graph-Mamba: Towards Long-Range Graph Sequence Modelling with Selective State Spaces☆335Updated 2 years ago
- Resources about xLSTM by Sepp Hochreiter☆318Updated last year
- Official implementation of the paper "FilterNet: Harnessing Frequency Filters for Time Series Forecasting"☆218Updated last year
- Code for "Is Mamba Effective for Time Series Forecasting?"☆369Updated 8 months ago
- The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…☆834Updated last month
- [AAAI 2025] Official Implementation of "Auto-Regressive Moving Diffusion Models for Time Series Forecasting"☆110Updated last year
- [ICML 2025] Official PyTorch implementation of the paper: 🎯 TimeDART: A Diffusion Autoregressive Transformer for Self-Supervised Time S…☆133Updated last month
- State Space Models☆72Updated last year
- Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis☆262Updated 6 months ago
- Convolutional layer for Kolmogorov-Arnold Network (KAN)☆115Updated 10 months ago