Alternatives and similar repositories for DifferentialTransformer:

Users that are interested in DifferentialTransformer are comparing it to the libraries listed below

• nanowell / Differential-Transformer-PyTorch
  PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …
  ☆57Updated 5 months ago
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆118Updated 2 months ago
• cheng-haha / KANs
  🕹️The toy examples of Kolmogorov-Arnold Network (Get Started Quickly)
  ☆75Updated 10 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆52Updated 2 months ago
• akaashdash / kansformers
  ☆127Updated 10 months ago
• YihongDong / FAN
  ☆212Updated 3 weeks ago
• jwzhanggy / tinyBIG
  tinybig for deep function learning
  ☆60Updated 3 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆190Updated 2 months ago
• jlamprou / Fourier-Analysis-Networks-FAN
  A pytorch implementation of Fourier Analysis Networks (FAN)
  ☆32Updated 5 months ago
• daxin007 / ARMD
  [AAAI 2025] Official Implementation of "Auto-Regressive Moving Diffusion Models for Time Series Forecasting"
  ☆65Updated last month
• badripatro / simba
  Simba
  ☆205Updated last year
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆90Updated 2 months ago
• zavareh1 / Wav-KAN
  This repository contains the codes to replicate the simulations from the paper: "Wav-KAN: Wavelet Kolmogorov-Arnold Networks". It showca…
  ☆135Updated last month
• tommyip / mamba2-minimal
  Minimal Mamba-2 implementation in PyTorch
  ☆181Updated 9 months ago
• Klassikcat / KANElectra
  Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)
  ☆28Updated this week
• XiangboGaoBarry / KA-Conv
  Fast Convolutional KAN
  ☆58Updated 10 months ago
• vulus98 / Rethinking-attention
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆43Updated 3 months ago
• NISCHALPI / xLSTM-and-mLSTM
  An implementation of mLSTM and sLSTM in PyTorch.
  ☆27Updated 10 months ago
• StarostinV / convkan
  Convolutional layer for Kolmogorov-Arnold Network (KAN)
  ☆94Updated last week
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆76Updated 11 months ago
• lunaaa95 / mou
  Mamba or Transformer for Time Series Forecasting? Mixture of Universals (MoU) Is All You Need.
  ☆41Updated last month
• smvorwerk / xlstm-cuda
  Cuda implementation of Extended Long Short Term Memory (xLSTM) with C++ and PyTorch ports
  ☆86Updated 9 months ago
• yyyujintang / VMRNN-PyTorch
  Official repository for CVPR24 Precognition Workshop Paper: VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotem…
  ☆122Updated 11 months ago
• Leopold2333 / Bi-Mamba4TS
  ☆46Updated 3 weeks ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆163Updated 2 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆101Updated 2 months ago
• Jinfeng-Xu / FKAN-GCF
  ☆32Updated 2 months ago
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆25Updated last year
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated 2 weeks ago
• Weixin-Liang / Mixture-of-Mamba
  ☆40Updated 2 months ago