Alternatives and similar repositories for CoE

Users that are interested in CoE are comparing it to the libraries listed below

• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆213Updated 2 weeks ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆166Updated last week
• QwenLM / ParScale
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆345Updated 2 weeks ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆94Updated 2 months ago
• hao-ai-lab / Dynasor
  Simple extension on vLLM to help you speed up reasoning model without training.
  ☆152Updated this week
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆59Updated last month
• Tencent / llm.hunyuan.T1
  ☆77Updated last month
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆155Updated last month
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆151Updated last month
• THUDM / T1
  Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling
  ☆102Updated 4 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆207Updated 3 weeks ago
• XunhaoLai / native-sparse-attention-triton
  Efficient triton implementation of Native Sparse Attention.
  ☆155Updated last week
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆231Updated 3 weeks ago
• QwenLM / WorldPM
  ☆80Updated 2 weeks ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆145Updated 2 months ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆221Updated last month
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆245Updated this week
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆143Updated 8 months ago
• LLM360 / MegaMath
  An Open Math Pre-trainng Dataset with 370B Tokens.
  ☆87Updated last month
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆132Updated 11 months ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆160Updated 11 months ago
• ypwang61 / One-Shot-RLVR
  official repository for “Reinforcement Learning for Reasoning in Large Language Models with One Training Example”
  ☆223Updated last week
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆149Updated 2 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆174Updated last month
• GAIR-NLP / LIMR
  ☆201Updated 3 months ago
• NovaSky-AI / SkyRL
  SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning
  ☆343Updated last week
• ReTool-RL / ReTool
  ☆96Updated last month
• thu-nics / MoA
  The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆128Updated last week
• OpenSparseLLMs / Linear-MoE
  ☆93Updated 2 weeks ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆184Updated 2 months ago