Alternatives and similar repositories for HybriMoE-Preview

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• zjunlp / DynamicKnowledgeCircuits
  [ACL 2025] How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆41Updated last month
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆59Updated last year
• EsmaeilNarimissa / aws-sft-grpo-budget-llm-finetune
  ☆19Updated 3 months ago
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆26Updated 10 months ago
• UKPLab / arxiv2025-inherent-limits-plms
  Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…
  ☆13Updated 7 months ago
• TianheL / LM-Implicit-Reasoning
  [ACL 2025 Findings] Implicit Reasoning in Transformers is Reasoning through Shortcuts
  ☆16Updated 5 months ago
• hetailang / SqueezeAttention
  ☆38Updated 10 months ago
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆45Updated 6 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated last year
• OpenMOSS / Lorsa
  ☆25Updated 2 months ago
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆18Updated 4 months ago
• shenao-zhang / reward-augmented-preference
  The official implementation of Preference Data Reward-Augmentation.
  ☆18Updated 4 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 4 months ago
• jiwonsong-dev / ReasoningPathCompression
  Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆21Updated 3 months ago
• sunblaze-ucb / AgentSynth
  AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents
  ☆30Updated 2 months ago
• StigLidu / DualDistill
  The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆94Updated this week
• ALT-JS / OthelloSAE
  CS194-196 Course Project
  ☆15Updated 6 months ago
• metal-chart-generation / metal
  ☆40Updated 3 months ago
• sunnynexus / RetroLLM
  RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation [ACL 2025]
  ☆114Updated 7 months ago
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 9 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆85Updated 3 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆88Updated this week
• Geaming2002 / Ruler
  Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models
  ☆38Updated 11 months ago
• arcee-ai / DAM
  ☆54Updated 9 months ago
• rohinmanvi / Capability-Aware-and-Mid-Generation-Self-Evaluations
  ☆21Updated last month
• Babelscape / LLM-Oasis
  This repository contains the resource introduced in the paper: "Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis"…
  ☆23Updated 8 months ago
• ttw1018 / MoPE-DST
  The code for "MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking"
  ☆18Updated 7 months ago
• F2-Song / Weak-to-Strong-Decoding
  The official implementation of "Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding"
  ☆22Updated 2 months ago
• ZihanWang314 / coeCheck
  ☆19Updated 5 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆33Updated last week