Alternatives and similar repositories for HybriMoE-Preview

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆60Updated last year
• zjunlp / DynamicKnowledgeCircuits
  [ACL 2025] How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆45Updated 6 months ago
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆29Updated last year
• UKPLab / arxiv2025-inherent-limits-plms
  Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…
  ☆13Updated last year
• EsmaeilNarimissa / aws-sft-grpo-budget-llm-finetune
  ☆19Updated 8 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated 2 years ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆125Updated 5 months ago
• tianyi-lab / C3PO
  [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆19Updated 9 months ago
• OpenMOSS / Lorsa
  ☆29Updated 2 months ago
• ZihanWang314 / coeCheck
  ☆19Updated 10 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆260Updated last week
• Marvis-Lab / SWE-EVO
  ☆29Updated last month
• open-thoughts / OpenThoughts-Agent
  Data recipes and robust infrastructure for training AI agents
  ☆84Updated this week
• shenao-zhang / reward-augmented-preference
  The official implementation of Preference Data Reward-Augmentation.
  ☆18Updated 8 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆138Updated 7 months ago
• tval2 / contextual-pruning
  Library to facilitate pruning of LLMs based on context
  ☆32Updated last year
• ChuangtaoChen-TUM / LiveMind
  ☆15Updated last year
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆102Updated 4 months ago
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆38Updated last year
• metal-chart-generation / metal
  ☆42Updated 8 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated 3 months ago
• THUDM / CaRR
  This repository contains the code and data for the paper "Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents wit…
  ☆50Updated 2 weeks ago
• Geaming2002 / Ruler
  Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models
  ☆40Updated last year
• royeisen / reasoning_loading_bar
  ☆53Updated 6 months ago
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆168Updated 5 months ago
• CERT-Lab / lora-sb
  Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
  ☆52Updated 3 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆42Updated last month
• TianheL / LM-Implicit-Reasoning
  [ACL 2025 Findings] Implicit Reasoning in Transformers is Reasoning through Shortcuts
  ☆17Updated 10 months ago
• rohinmanvi / Capability-Aware-and-Mid-Generation-Self-Evaluations
  ☆21Updated 6 months ago