Alternatives and similar repositories for HybriMoE-Preview

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• zjunlp / DynamicKnowledgeCircuits
  How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆36Updated 2 months ago
• hetailang / SqueezeAttention
  ☆37Updated 8 months ago
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆22Updated 8 months ago
• EsmaeilNarimissa / aws-sft-grpo-budget-llm-finetune
  ☆18Updated last month
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆59Updated last year
• 66RING / CritiPrefill
  Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".
  ☆14Updated 9 months ago
• OpenMOSS / Lorsa
  ☆20Updated last week
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆44Updated 4 months ago
• rohinmanvi / Capability-Aware_and_Mid-Generation_Self-Evaluations
  ☆21Updated 6 months ago
• jiwonsong-dev / ReasoningPathCompression
  Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆16Updated last month
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆73Updated last month
• NiuTrans / ForgettingCurve
  A benchmark for testing memorization abilities of LMs
  ☆20Updated 8 months ago
• McGill-NLP / agent-reward-bench
  AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  ☆18Updated last month
• arcee-ai / DAM
  ☆51Updated 7 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 7 months ago
• giangdip2410 / HyperRouter
  Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"
  ☆33Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆36Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• complex-reasoning / RPG
  The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆35Updated this week
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆32Updated 3 months ago
• ZihanWang314 / coeCheck
  ☆16Updated 3 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆25Updated last month
• Zyphra / Zyda_processing
  ☆35Updated last year
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆68Updated 3 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆33Updated 3 months ago
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆15Updated 2 months ago
• axeld5 / pali_reason
  Testing paligemma2 finetuning on reasoning dataset
  ☆18Updated 5 months ago