Alternatives and similar repositories for MomentumSMoE

Users that are interested in MomentumSMoE are comparing it to the libraries listed below

• Cohere-Labs-Community / iterative-data-selection
  ☆28Updated 6 months ago
• Fsoft-AIC / LibMoE
  LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS
  ☆37Updated last week
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆25Updated 6 months ago
• linkedin / ControlLLM
  Control LLM
  ☆14Updated last month
• taesiri / ZoomIsAllYouNeed
  Official code and data for NeurIPS 2023 paper "ImageNet-Hard: The Hardest Images Remaining from a Study of the Power of Zoom and Spatial …
  ☆38Updated last year
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆52Updated 10 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆51Updated 3 months ago
• jongwooko / distillm-2
  ☆12Updated 2 months ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆21Updated 4 months ago
• lapisrocks / DiscreteAdversarialDistillation
  [NeurIPS 2023] Official repository for "Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models"
  ☆12Updated 10 months ago
• sail-sg / LightTrans
  The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"
  ☆19Updated 3 weeks ago
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆29Updated last year
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 5 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆26Updated 6 months ago
• kpup1710 / CAMEx
  [ICLR 2025] CAMEx: Curvature-Aware Merging of Experts
  ☆19Updated 2 months ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆44Updated 2 years ago
• WangWenhao0716 / PDF-Embedding
  [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"
  ☆16Updated 7 months ago
• tianyi-lab / R2-T2
  Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated 2 months ago
• Ghaith81 / dropkan
  DropKAN (Dropout Kolmogorov Arnold Networks)
  ☆13Updated 9 months ago
• qiuzh20 / RMoE
  Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)
  ☆20Updated 9 months ago
• apple / ml-act
  ☆43Updated 5 months ago
• WenjunHuang94 / ML-Mamba
  ML-Mamba: Efficient Multi-Modal Large Language Model Utilizing Mamba-2
  ☆64Updated 5 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆78Updated 6 months ago
• Picsart-AI-Research / OpenBias
  [CVPR 2024 Highlight] OpenBias: Open-set Bias Detection in Text-to-Image Generative Models
  ☆23Updated 3 months ago
• tanganke / weight-ensembling_MoE
  Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
  ☆24Updated 11 months ago
• Christina200 / Online-LoRA-official
  [WACV 2025] Official implementation of "Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation" by Xiwen Wei, Guihong L…
  ☆36Updated 6 months ago
• AlignmentResearch / learned-planner
  Interpretability tools for recurrent convolutional networks (DRC) that play Sokoban
  ☆12Updated 2 months ago
• locuslab / llava-token-compression
  ☆41Updated 6 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆54Updated 8 months ago
• gmongaras / Cottention_Transformer
  Code for the paper "Cottention: Linear Transformers With Cosine Attention"
  ☆17Updated 6 months ago