Alternatives and similar repositories for FourierTransformer:

Users that are interested in FourierTransformer are comparing it to the libraries listed below

• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆33Updated 3 months ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆41Updated 2 years ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 5 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated 9 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆51Updated 2 months ago
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆38Updated 8 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆70Updated 10 months ago
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆62Updated 8 months ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆60Updated last month
• ZetangForward / Bridge_Gap_Diffusion
  ☆33Updated last year
• Adamdad / rational_kat_cu
  ☆42Updated last month
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆117Updated 10 months ago
• Shwai-He / SparseAdapter
  Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"
  ☆18Updated 9 months ago
• VijayLingam95 / SVFT
  ☆26Updated 7 months ago
• HKUNLP / DiffuLLaMA
  DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆71Updated last month
• r-three / smear
  ☆27Updated last year
• duguodong7 / pcb-merging
  [NeurIPS 2024] For paper Parameter Competition Balancing for Model Merging
  ☆32Updated 3 months ago
• DavidFanzz / SCMoE
  ☆17Updated 7 months ago
• assafbk / DeciMamba
  Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
  ☆22Updated 5 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 6 months ago
• adymaharana / d2pruning
  ☆31Updated last year
• igul222 / plaid
  ☆78Updated last year
• sanagno / adaptively_sparse_attention
  ☆18Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆80Updated last year
• Itamarzimm / UnifiedImplicitAttnRepr
  ☆36Updated 7 months ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆47Updated last month
• SJTU-DeepVisionLab / FLoRA
  ☆33Updated 5 months ago
• ruthless-man / Awesome-Learn-from-Model
  Awesome Learn From Model Beyond Fine-Tuning: A Survey
  ☆54Updated last month
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated last year