Alternatives and similar repositories for self-hosted

Users that are interested in self-hosted are comparing it to the libraries listed below

• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆326Updated last year
• git-cloner / aliendao
  huggingface mirror download
  ☆588Updated 9 months ago
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆297Updated 6 months ago
• modelscope / easydistill
  a toolkit on knowledge distillation for large language models
  ☆249Updated 3 weeks ago
• infinigence / Infini-Megrez
  ☆341Updated 3 months ago
• mindspore-lab / mindformers
  ☆181Updated this week
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆152Updated last month
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆274Updated 5 months ago
• MigoXLab / dingo
  Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
  ☆617Updated last week
• PaddlePaddle / PaddleMIX
  Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pret…
  ☆712Updated last week
• VectorSpaceLab / MegaPairs
  [ACL 2025 Oral] 🔥🔥 MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval
  ☆240Updated 2 months ago
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆138Updated last year
• Tele-AI / TeleChat2
  星辰语义大模型TeleChat2是由中国电信人工智能研究院研发训练的大语言模型，是首个完全国产算力训练并开源的千亿参数模型
  ☆266Updated 5 months ago
• david-xinyuwei / david-share
  ☆390Updated this week
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆1,573Updated this week
• infinigence / Infini-Megrez-Omni
  ☆242Updated 11 months ago
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆446Updated last year
• ShaohonChen / Qwen3-SmVL
  将SmolVLM2的视觉头与Qwen3-0.6B模型进行了拼接微调
  ☆506Updated 4 months ago
• DeepLink-org / dlinfer
  ☆72Updated 2 weeks ago
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆196Updated 3 years ago
• datawhalechina / sora-tutorial
  ☆103Updated last year
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
  ☆243Updated last week
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆584Updated last year
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆785Updated 8 months ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆365Updated last year
• tpoisonooo / ROGRAG
  [ACL2025 demo track] ROGRAG: A Robustly Optimized GraphRAG Framework
  ☆192Updated last month
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,381Updated this week
• flagos-ai / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆466Updated this week
• HFAiLab / hai-platform
  一种任务级GPU算力分时调度的高性能深度学习训练平台
  ☆731Updated 2 years ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆280Updated 11 months ago