Alternatives and similar repositories for HybriMoE-Preview

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• EsmaeilNarimissa / aws-sft-grpo-budget-llm-finetune
  ☆19Updated 4 months ago
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆26Updated 10 months ago
• zjunlp / DynamicKnowledgeCircuits
  [ACL 2025] How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆43Updated 2 months ago
• hetailang / SqueezeAttention
  ☆38Updated 11 months ago
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆60Updated last year
• UKPLab / arxiv2025-inherent-limits-plms
  Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…
  ☆13Updated 8 months ago
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆18Updated 5 months ago
• TianheL / LM-Implicit-Reasoning
  [ACL 2025 Findings] Implicit Reasoning in Transformers is Reasoning through Shortcuts
  ☆16Updated 6 months ago
• OpenMOSS / Lorsa
  ☆27Updated 3 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated last year
• ChuangtaoChen-TUM / LiveMind
  ☆14Updated 10 months ago
• shenao-zhang / reward-augmented-preference
  The official implementation of Preference Data Reward-Augmentation.
  ☆18Updated 4 months ago
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆99Updated 3 weeks ago
• MaxBelitsky / cache-steering
  KV Cache Steering for Inducing Reasoning in Small Language Models
  ☆39Updated last month
• royeisen / reasoning_loading_bar
  ☆51Updated 2 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆95Updated this week
• ALT-JS / OthelloSAE
  CS194-196 Course Project
  ☆15Updated 7 months ago
• sunnynexus / RetroLLM
  RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation [ACL 2025]
  ☆117Updated 7 months ago
• sunblaze-ucb / AgentSynth
  AgentSynth: Scalable Task Generation for Generalist Computer-Use Agents
  ☆31Updated 2 weeks ago
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆46Updated 7 months ago
• THUDM / DeepDive
  DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RL
  ☆95Updated last week
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 10 months ago
• Geaming2002 / Ruler
  Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models
  ☆39Updated 11 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆116Updated last month
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆34Updated 3 weeks ago
• NiuTrans / ForgettingCurve
  A benchmark for testing memorization abilities of LMs
  ☆20Updated 11 months ago
• TergelMunkhbat / concise-reasoning
  Code for paper called Self-Training Elicits Concise Reasoning in Large Language Models
  ☆41Updated 5 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 6 months ago
• CERT-Lab / lora-sb
  Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
  ☆51Updated 3 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year