Alternatives and similar repositories for MomentumSMoE

Users that are interested in MomentumSMoE are comparing it to the libraries listed below

• tim-lawson / skip-middle
  Learning to Skip the Middle Layers of Transformers
  ☆15Updated 3 months ago
• hkust-nlp / model-task-align-rl
  The official code repository for the paper "Mirage or Method? How Model–Task Alignment Induces Divergent RL Conclusions".
  ☆15Updated 2 months ago
• BryceZhuo / PolyCom
  The official implementation of ICLR 2025 paper "Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models".
  ☆15Updated 6 months ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆27Updated 3 months ago
• czg1225 / dParallel
  dParallel: Learnable Parallel Decoding for dLLMs
  ☆42Updated last month
• tianyi-lab / R2-T2
  [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"
  ☆16Updated 8 months ago
• shachardon / naturally_occurring_feedback
  ☆14Updated last month
• Cohere-Labs-Community / iterative-data-selection
  ☆30Updated last year
• Taishi-N324 / Drop-Upcycling
  [ICLR 2025] Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization
  ☆19Updated last month
• TianheL / LM-Implicit-Reasoning
  [ACL 2025 Findings] Implicit Reasoning in Transformers is Reasoning through Shortcuts
  ☆16Updated 8 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 7 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆35Updated 8 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆33Updated 9 months ago
• JingMog / THOR
  Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".
  ☆27Updated 2 months ago
• yayayacc / MUR
  ☆45Updated last month
• mlbio-epfl / joint-inference
  [ICLR 2025] Large (Vision) Language Models are Unsupervised In-Context Learners
  ☆21Updated 5 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆49Updated 6 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 6 months ago
• VijayLingam95 / SVFT
  ☆33Updated 9 months ago
• kuleshov-group / remdm
  Remasking Discrete Diffusion Models with Inference-Time Scaling
  ☆54Updated 8 months ago
• sail-sg / feedback-conditional-policy
  Code for "Language Models Can Learn from Verbal Feedback Without Scalar Rewards"
  ☆51Updated last month
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆39Updated last year
• Fsoft-AIC / LibMoE
  LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS
  ☆44Updated last week
• aeroplanepaper / GRPO-LEAD
  ☆30Updated 2 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆51Updated 9 months ago
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆61Updated last year
• nasosger / MuToR
  [NeurIPS '25] Multi-Token Prediction Needs Registers
  ☆24Updated 2 months ago
• euclid-multimodal / Euclid
  ☆17Updated 10 months ago
• TIGER-AI-Lab / Hierarchical-Reasoner
  Emergent Hierarchical Reasoning in LLMs/VLMs through Reinforcement Learning
  ☆48Updated 3 weeks ago