Alternatives and similar repositories for HybriMoE-Preview:

Users that are interested in HybriMoE-Preview are comparing it to the libraries listed below

• zjunlp / DynamicKnowledgeCircuits
  How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training
  ☆30Updated last week
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆22Updated 6 months ago
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆57Updated 10 months ago
• metal-chart-generation / metal
  ☆24Updated last month
• hetailang / SqueezeAttention
  ☆37Updated 6 months ago
• sunblaze-ucb / reasoning_ladder
  ☆24Updated last week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆88Updated this week
• UKPLab / arxiv2025-inherent-limits-plms
  Code repository for the paper "The Inherent Limits of Pretrained LLMs: The Unexpected Convergence of Instruction Tuning and In-Context Le…
  ☆13Updated 3 months ago
• YutongWang1216 / DocMTAgent
  Code and data releases for the paper -- DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory
  ☆40Updated 2 months ago
• tajwarfahim / paprika
  Official Code Release for "Training a Generally Curious Agent"
  ☆20Updated 3 weeks ago
• tianyi-lab / C3PO
  Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆14Updated 2 weeks ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• facebookresearch / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆23Updated this week
• TianheL / LM-Implicit-Reasoning
  [Arxiv] Implicit Reasoning in Transformers is Reasoning through Shortcuts
  ☆14Updated last month
• TergelMunkhbat / concise-reasoning
  Code for paper called Self-Training Elicits Concise Reasoning in Large Language Models
  ☆24Updated this week
• ZihanWang314 / coeCheck
  ☆16Updated last month
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 5 months ago
• 66RING / CritiPrefill
  Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".
  ☆14Updated 7 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆29Updated last month
• rohinmanvi / Capability-Aware_and_Mid-Generation_Self-Evaluations
  ☆20Updated 4 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆30Updated last month
• CERT-Lab / lora-sb
  Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
  ☆46Updated 2 months ago
• sail-sg / FlowReasoner
  ☆63Updated this week
• rosewang2008 / posr
  Problem-Oriented Segmentation and Retrieval EMNLP 2024 Findings
  ☆31Updated 5 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆71Updated 7 months ago
• ChuangtaoChen-TUM / LiveMind
  ☆13Updated 5 months ago
• dinobby / Symbolic-MoE
  The code implementation of Symbolic-MoE
  ☆27Updated last month
• fairyshine / Chain-of-Tools
  The official implementation of the paper "Chain-of-Tools: Utilizing Massive Unseen Tools in the CoT Reasoning of Frozen Language Models".
  ☆64Updated last month
• allenai / infinigram-api
  ☆51Updated last week
• letta-ai / sleep-time-compute
  accompany material for sleep time compute paper
  ☆17Updated last week