Alternatives and similar repositories for Delta-CoMe:

Users that are interested in Delta-CoMe are comparing it to the libraries listed below

• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆129Updated 9 months ago
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆185Updated 6 months ago
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆132Updated last month
• llm-factory / imitater
  Imitate OpenAI with Local Models
  ☆88Updated 6 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆70Updated last year
• pleisto / yuren-baichuan-7b
  基于baichuan-7b的开源多模态大语言模型
  ☆73Updated last year
• Bui1dMySea / MemLong
  ☆92Updated 3 months ago
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated 11 months ago
• FlagOpen / Infinity-Instruct
  ☆45Updated 9 months ago
• xverse-ai / XVERSE-65B
  XVERSE-65B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆139Updated 11 months ago
• SomeoneKong / llm_long_context_bench202405
  ☆29Updated 6 months ago
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆37Updated 3 months ago
• ziwang-com / zero-lora
  zero零训练llm调参
  ☆31Updated last year
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated 11 months ago
• 18907305772 / FuseAI
  FuseAI Project
  ☆84Updated last month
• SUSTech-IDEA / SUS-Chat
  SUS-Chat: Instruction tuning done right
  ☆48Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆36Updated last year
• QwenLM / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆132Updated 3 months ago
• shootime2021 / APUS-xDAN-4.0-moe
  Its an open source LLM based on MOE Structure.
  ☆58Updated 8 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆61Updated last year
• xverse-ai / XVERSE-V-13B
  ☆78Updated 10 months ago
• multimodal-art-projection / Megatron-LM-NEO
  ☆37Updated 10 months ago
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆246Updated 3 months ago
• microsoft / RedStone
  The RedStone repository includes code for preparing extensive datasets used in training large language models.
  ☆118Updated last month
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆67Updated 8 months ago
• ClosedCharacter / Peach
  我们是第一个完全可商用的角色大模型。
  ☆39Updated 7 months ago