Alternatives and similar repositories for HybriMoE-Preview

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• zjunlp / DynamicKnowledgeCircuits
  [ACL 2025] How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆45Updated 5 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆61Updated last year
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆29Updated last year
• EsmaeilNarimissa / aws-sft-grpo-budget-llm-finetune
  ☆19Updated 7 months ago
• UKPLab / arxiv2025-inherent-limits-plms
  Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…
  ☆13Updated 11 months ago
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆101Updated 4 months ago
• tianyi-lab / C3PO
  [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆19Updated 8 months ago
• sunnynexus / RetroLLM
  [ACL 2025] RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation
  ☆118Updated 11 months ago
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆169Updated 4 months ago
• long-horizon-execution / measuring-execution
  ☆49Updated 3 months ago
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆57Updated 10 months ago
• Geaming2002 / Ruler
  Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models
  ☆40Updated last year
• OpenMOSS / Lorsa
  ☆29Updated last month
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆249Updated last week
• ALT-JS / OthelloSAE
  CS194-196 Course Project
  ☆14Updated 10 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated 2 years ago
• rohinmanvi / Capability-Aware-and-Mid-Generation-Self-Evaluations
  ☆21Updated 5 months ago
• ZihanWang314 / coeCheck
  ☆19Updated 10 months ago
• metal-chart-generation / metal
  ☆41Updated 7 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆111Updated 8 months ago
• CERT-Lab / lora-sb
  Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
  ☆52Updated 2 months ago
• tiiuae / Falcon-H1
  All information and news with respect to Falcon-H1 series
  ☆94Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆62Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated 2 months ago
• sunnweiwei / PPP-Agent
  ☆93Updated 2 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆124Updated 5 months ago
• allenai / bolmo-core
  Code for Bolmo: Byteifying the Next Generation of Language Models
  ☆111Updated 2 weeks ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 10 months ago
• royeisen / reasoning_loading_bar
  ☆52Updated 6 months ago