Alternatives and similar repositories for ipex-llm-tutorial

Users that are interested in ipex-llm-tutorial are comparing it to the libraries listed below

• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆421Updated 11 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆257Updated last month
• intel / xFasterTransformer
  ☆427Updated this week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆128Updated 2 weeks ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated 2 months ago
• OpenPPL / ppl.llm.serving
  ☆128Updated 6 months ago
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆457Updated last week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆238Updated 3 months ago
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆595Updated 6 months ago
• liguodongiot / ai-system
  LLM/MLOps/LLMOps
  ☆94Updated last month
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• OpenPPL / ppl.nn.llm
  ☆139Updated last year
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆220Updated last week
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆377Updated this week
• mindspore-lab / mindformers
  ☆168Updated this week
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆297Updated 5 months ago
• OpenPPL / ppl.pmx
  ☆59Updated 7 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆308Updated this week
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆82Updated last year
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆101Updated last year
• InfiniTensor / InfiniTensor
  ☆236Updated 2 weeks ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆71Updated 2 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆243Updated last year
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆815Updated this week
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in the Triton Language.
  ☆583Updated this week
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆382Updated last month
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆147Updated last year
• Tencent / KsanaLLM
  ☆435Updated this week
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆440Updated this week