Alternatives and similar repositories for ipex-llm-tutorial:

Users that are interested in ipex-llm-tutorial are comparing it to the libraries listed below

• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆236Updated 2 weeks ago
• intel / xFasterTransformer
  ☆403Updated this week
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆399Updated 7 months ago
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆581Updated 2 months ago
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆267Updated last month
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆124Updated 6 months ago
• liguodongiot / ai-system
  LLM/MLOps/LLMOps
  ☆75Updated 5 months ago
• mindspore-lab / mindformers
  ☆154Updated this week
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆92Updated 11 months ago
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆305Updated this week
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X
  ☆175Updated this week
• sunkx109 / llama
  Inference code for LLaMA models
  ☆113Updated last year
• xinyuwei-david / david-share
  ☆250Updated this week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆94Updated last week
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆527Updated 11 months ago
• datawhalechina / llm-deploy
  大模型/LLM推理和部署理论与实践
  ☆184Updated 3 weeks ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆429Updated this week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆56Updated last month
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆296Updated last month
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆114Updated 2 months ago
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆715Updated 10 months ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆356Updated last year
• OpenPPL / ppl.llm.serving
  ☆127Updated 2 months ago
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆211Updated 4 months ago
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆299Updated this week
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆237Updated 11 months ago
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆81Updated this week
• Tlntin / qwen-ascend-llm
  ☆38Updated 4 months ago