Alternatives and similar repositories for MomentumSMoE

Users that are interested in MomentumSMoE are comparing it to the libraries listed below

• Cohere-Labs-Community / iterative-data-selection
  ☆28Updated 8 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆55Updated last year
• juyongjiang / KaSA
  [ICLR'25] Code for KaSA, an official implementation of "KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models"
  ☆18Updated 6 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 5 months ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆25Updated 6 months ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆27Updated last month
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆27Updated 2 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆60Updated 9 months ago
• facebookresearch / ModelRatatouille
  Recycling diverse models
  ☆45Updated 2 years ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 5 months ago
• mlbio-epfl / joint-inference
  [ICLR 2025] Large (Vision) Language Models are Unsupervised In-Context Learners
  ☆15Updated last month
• sail-sg / LightTrans
  The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"
  ☆20Updated 2 months ago
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆29Updated last year
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆27Updated 4 months ago
• EPFL-VILAB / fm-vision-evals
  ☆57Updated 2 weeks ago
• KindXiaoming / physics_of_skill_learning
  We study toy models of skill learning.
  ☆29Updated 5 months ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 6 months ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 9 months ago
• SLIT-AI / ADPA
  [ICLR2025 Spotlight] Advantage-Guided Distillation for Preference Alignment in Small Language Models
  ☆21Updated 5 months ago
• locuslab / llava-token-compression
  ☆42Updated 8 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆40Updated last year
• raymin0223 / mixture_of_recursions
  Mixture-of-Recursions: Learning Dynamic Recursive Depths for Adaptive Token-Level Thinking
  ☆64Updated last month
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 3 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 7 months ago
• jongwooko / distillm-2
  Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)
  ☆29Updated 3 weeks ago
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆15Updated 4 months ago
• facebookresearch / tce
  Library for the Test-based Calibration Error (TCE) metric to quantify the degree to classifier calibration.
  ☆13Updated last year
• Ghaith81 / dropkan
  DropKAN (Dropout Kolmogorov Arnold Networks)
  ☆14Updated 3 weeks ago
• Hongcheng-Gao / HAVEN
  Code and data for paper "Exploring Hallucination of Large Multimodal Models in Video Understanding: Benchmark, Analysis and Mitigation".
  ☆17Updated 2 months ago