Alternatives and similar repositories for Delta-CoMe

Users that are interested in Delta-CoMe are comparing it to the libraries listed below

• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆189Updated 10 months ago
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆144Updated last month
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆136Updated last year
• Bui1dMySea / MemLong
  ☆94Updated 7 months ago
• xverse-ai / XVERSE-MoE-A4.2B
  XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆40Updated last year
• StarRing2022 / R1-Nature
  最简易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。
  ☆44Updated 5 months ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆110Updated 2 months ago
• Tongyi-Zhiwen / QwenLong-L1
  ☆287Updated 2 months ago
• SUSTech-IDEA / SUS-Chat
  SUS-Chat: Instruction tuning done right
  ☆49Updated last year
• aliyun / qwen-dianjin
  Qwen DianJin: LLMs for the Financial Industry by Alibaba Cloud
  ☆119Updated 2 months ago
• modelscope / easydistill
  a toolkit on knowledge distillation for large language models
  ☆127Updated this week
• InternLM / Condor
  [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
  ☆32Updated 2 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆33Updated last year
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆77Updated last year
• Tencent / llm.hunyuan.T1
  ☆77Updated 3 months ago
• xverse-ai / XVERSE-65B
  XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆139Updated last year
• inclusionAI / Ling
  Ling is a MoE LLM provided and open-sourced by InclusionAI.
  ☆181Updated 2 months ago
• pangu-tech / pangu-ultra
  ☆66Updated 2 months ago
• WePOINTS / WePOINTS
  ☆173Updated 5 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated last year
• FlagOpen / Infinity-Instruct
  ☆48Updated last year
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆164Updated 2 weeks ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆181Updated last month
• SkyworkAI / Skywork-Reward-V2
  Scaling Preference Data Curation via Human-AI Synergy
  ☆94Updated 3 weeks ago
• SuperGPQA / SuperGPQA
  ☆157Updated 3 months ago
• 360CVGroup / 360VL
  Our 2nd-gen LMM
  ☆34Updated last year
• Alibaba-NLP / MaskSearch
  Repo for "MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability"
  ☆136Updated 2 months ago
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆39Updated 10 months ago