Alternatives and similar repositories for MomentumSMoE:

Users that are interested in MomentumSMoE are comparing it to the libraries listed below

• for-ai / iterative-data-selection
  ☆23Updated 3 months ago
• gmongaras / Cottention_Transformer
  Code for the paper "Cottention: Linear Transformers With Cosine Attention"
  ☆13Updated 4 months ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆24Updated 4 months ago
• AlignmentResearch / learned-planner
  Interpretability tools for recurrent networks that play Sokoban
  ☆10Updated last month
• Lillianwei-h / MMIE
  [ICLR'25 Oral] MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models
  ☆27Updated 3 months ago
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆36Updated 8 months ago
• pixeli99 / MixLN
  Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yi…
  ☆16Updated 2 months ago
• Ghaith81 / dropkan
  DropKAN (Dropout Kolmogorov Arnold Networks)
  ☆12Updated 6 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆42Updated 7 months ago
• locuslab / llava-token-compression
  ☆38Updated 3 months ago
• Vinoground / Vinoground
  ☆10Updated 3 months ago
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 11 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆52Updated 6 months ago
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆32Updated 10 months ago
• Doraemonzzz / hgru2-pytorch
  ☆24Updated 4 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆25Updated 10 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆49Updated 4 months ago
• apple / ml-rpm-bench
  ☆39Updated 6 months ago
• Itamarzimm / UnifiedImplicitAttnRepr
  [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation
  ☆37Updated 8 months ago
• yixuantt / FinMTEB
  FinMTEB: Finance Massive Text Embedding Benchmark
  ☆14Updated this week
• sjelassi / transformers_ssm_copy
  ☆30Updated 11 months ago
• Optimization-AI / fast_clip
  ☆22Updated 4 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆51Updated 5 months ago
• wangxu0820 / NegativePrompt
  The official GitHub page for paper "NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional St…
  ☆20Updated 9 months ago
• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆40Updated 3 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆43Updated 2 weeks ago