Alternatives and similar repositories for ipex-llm-tutorial

Users that are interested in ipex-llm-tutorial are comparing it to the libraries listed below

• intel / xFasterTransformer
  ☆430Updated 3 weeks ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆426Updated last year
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆265Updated 2 months ago
• david-xinyuwei / david-share
  ☆355Updated this week
• mindspore-lab / mindformers
  ☆174Updated this week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆85Updated 5 months ago
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆437Updated 3 weeks ago
• Tencent / KsanaLLM
  ☆503Updated 3 weeks ago
• omni-ai-npu / omni-infer
  Omni_Infer is a suite of inference accelerators designed for the Ascend NPU platform, offering native support and an expanding feature se…
  ☆73Updated last week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆252Updated 7 months ago
• pandada8 / llm-inference-benchmark
  LLM 推理服务性能测试
  ☆43Updated last year
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆150Updated last year
• ShaohonChen / transformers_from_scratch
  pretrain a wiki llm using transformers
  ☆51Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆606Updated 10 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆248Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆132Updated 2 weeks ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆358Updated last week
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆86Updated last year
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆132Updated last year
• alipay / PainlessInferenceAcceleration
  Accelerate inference without tears
  ☆333Updated last week
• Tlntin / qwen-ascend-llm
  ☆50Updated 11 months ago
• liguodongiot / ai-system
  LLM/MLOps/LLMOps
  ☆116Updated 4 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆197Updated 3 weeks ago
• MooreThreads / vllm_musa
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆64Updated 11 months ago
• DeepLink-org / dlinfer
  ☆63Updated 3 weeks ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆248Updated this week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆115Updated last year
• sihyeong / Awesome-LLM-Inference-Engine
  ☆137Updated 3 months ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆874Updated last week
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆1,179Updated last week