Alternatives and similar repositories for Delta-CoMe

Users that are interested in Delta-CoMe are comparing it to the libraries listed below

• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆132Updated 11 months ago
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆188Updated 8 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆166Updated last week
• SuperGPQA / SuperGPQA
  ☆150Updated last month
• multimodal-art-projection / Megatron-LM-NEO
  ☆40Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 4 months ago
• Bui1dMySea / MemLong
  ☆94Updated 5 months ago
• LLM360 / MegaMath
  An Open Math Pre-trainng Dataset with 370B Tokens.
  ☆87Updated last month
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated last year
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆141Updated 3 months ago
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆95Updated last month
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆38Updated 5 months ago
• aliyun / qwen-dianjin
  Qwen DianJin: LLMs for the Financial Industry by Alibaba Cloud
  ☆105Updated last week
• Tongyi-Zhiwen / QwenLong-L1
  ☆223Updated this week
• Chinese-Tiny-LLM / Chinese-Tiny-LLM
  ☆228Updated last year
• FlagOpen / Infinity-Instruct
  ☆47Updated 11 months ago
• InternLM / Condor
  [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
  ☆27Updated this week
• QwenLM / WorldPM
  ☆80Updated 2 weeks ago
• inclusionAI / Ling
  Ling is a MoE LLM provided and open-sourced by InclusionAI.
  ☆157Updated 2 weeks ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆101Updated 2 weeks ago
• THUDM / ChatGLM-Math
  ☆82Updated last year
• SUSTech-IDEA / SUS-Chat
  SUS-Chat: Instruction tuning done right
  ☆48Updated last year
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated 11 months ago
• ziwang-com / zero-lora
  zero零训练llm调参
  ☆31Updated last year
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• StarRing2022 / R1-Nature
  最简易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。
  ☆45Updated 3 months ago
• OpenLMLab / ChatZoo
  Light local website for displaying performances from different chat models.
  ☆86Updated last year
• Chen-GX / C-3PO
  [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…
  ☆22Updated last month
• step-law / steplaw
  ☆188Updated last month
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year