Alternatives and similar repositories for self-hosted

Users that are interested in self-hosted are comparing it to the libraries listed below

• padeoe / hf-mirror-site
  a huggingface mirror site.
  ☆321Updated last year
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆296Updated 6 months ago
• ShaohonChen / transformers_from_scratch
  pretrain a wiki llm using transformers
  ☆59Updated last year
• mindspore-lab / mindformers
  ☆180Updated last week
• infinigence / Infini-Megrez-Omni
  ☆241Updated 10 months ago
• git-cloner / aliendao
  huggingface mirror download
  ☆589Updated 8 months ago
• infinigence / Infini-Megrez
  ☆341Updated 2 months ago
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。
  ☆243Updated last week
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆137Updated last year
• david-xinyuwei / david-share
  ☆384Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆271Updated 4 months ago
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆1,520Updated this week
• thu-pacman / chitu
  High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
  ☆1,364Updated this week
• modelscope / easydistill
  a toolkit on knowledge distillation for large language models
  ☆229Updated last week
• JimmyMa99 / Roleplay-with-XiYou
  基于《西游记》原文、白话文、ChatGPT生成数据制作的，以InternLM2微调的角色扮演多LLM聊天室。 本项目将介绍关于角色扮演类 LLM 的一切，从数据获取、数据处理，到使用 XTuner 微调并部署至 OpenXLab，再到使用 LMDeploy 部署，以 op…
  ☆106Updated last year
• MigoXLab / dingo
  Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
  ☆602Updated last week
• flagos-ai / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆430Updated last week
• DeepLink-org / dlinfer
  ☆69Updated last week
• the-seeds / LLaMA-Factory-Doc
  LLaMA Factory Document
  ☆159Updated last week
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆138Updated 2 weeks ago
• Qihoo360 / Light-R1
  ☆756Updated last week
• bytedance / Valley
  Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.
  ☆267Updated 3 weeks ago
• modelscope / evalscope
  A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
  ☆2,191Updated this week
• Alibaba-NLP / VRAG
  Repo for "VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforce…
  ☆423Updated 2 months ago
• pandada8 / llm-inference-benchmark
  LLM 推理服务性能测试
  ☆44Updated 2 years ago
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆445Updated last year
• IEIT-Yuan / Yuan2.0-M32
  Mixture-of-Experts (MoE) Language Model
  ☆192Updated last year
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
  ☆198Updated 5 months ago
• aliyun / qwen-dianjin
  Qwen DianJin: LLMs for the Financial Industry by Alibaba Cloud（通义点金：阿里云金融大模型）
  ☆406Updated 2 weeks ago
• Tele-AI / TeleChat2
  星辰语义大模型TeleChat2是由中国电信人工智能研究院研发训练的大语言模型，是首个完全国产算力训练并开源的千亿参数模型
  ☆263Updated 5 months ago