Alternatives and similar repositories for HybriMoE-Preview

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• EsmaeilNarimissa / aws-sft-grpo-budget-llm-finetune
  ☆19Updated 6 months ago
• zjunlp / DynamicKnowledgeCircuits
  [ACL 2025] How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆44Updated 4 months ago
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆60Updated last year
• shenao-zhang / reward-augmented-preference
  The official implementation of Preference Data Reward-Augmentation.
  ☆18Updated 6 months ago
• hetailang / SqueezeAttention
  ☆38Updated last year
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆30Updated last year
• TianheL / LM-Implicit-Reasoning
  [ACL 2025 Findings] Implicit Reasoning in Transformers is Reasoning through Shortcuts
  ☆16Updated 8 months ago
• UKPLab / arxiv2025-inherent-limits-plms
  Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…
  ☆13Updated 10 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated last year
• ALT-JS / OthelloSAE
  CS194-196 Course Project
  ☆15Updated 9 months ago
• long-horizon-execution / measuring-execution
  ☆46Updated 2 months ago
• tianyi-lab / C3PO
  [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆18Updated 7 months ago
• royeisen / reasoning_loading_bar
  ☆52Updated 4 months ago
• OpenMOSS / Lorsa
  ☆29Updated 2 weeks ago
• scitix / MEAP
  Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
  ☆33Updated 6 months ago
• SakanaAI / natural_niches
  The code repository of the paper: Competition and Attraction Improve Model Fusion
  ☆165Updated 2 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆101Updated this week
• uq-project / UQ
  UQ: Assessing Language Models on Unsolved Questions
  ☆28Updated 2 months ago
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆54Updated 9 months ago
• metal-chart-generation / metal
  ☆40Updated 5 months ago
• Geaming2002 / Ruler
  Ruler: A Model-Agnostic Method to Control Generated Length for Large Language Models
  ☆39Updated last year
• NiuTrans / ForgettingCurve
  A benchmark for testing memorization abilities of LMs
  ☆20Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆40Updated last month
• CERT-Lab / lora-sb
  Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
  ☆52Updated last month
• StigLidu / DualDistill
  [EMNLP 2025] The official implementation for paper "Agentic-R1: Distilled Dual-Strategy Reasoning"
  ☆100Updated 2 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆123Updated 3 months ago
• Babelscape / LLM-Oasis
  This repository contains the resource introduced in the paper: "Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-Oasis"…
  ☆23Updated last month
• DeepAuto-AI / hip-attention
  Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
  ☆148Updated 2 weeks ago
• ZihanWang314 / coeCheck
  ☆19Updated 8 months ago