Alternatives and similar repositories for ipex-llm-tutorial

Users that are interested in ipex-llm-tutorial are comparing it to the libraries listed below

• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆254Updated last week
• intel / xFasterTransformer
  ☆427Updated this week
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆419Updated 10 months ago
• mindspore-lab / mindformers
  ☆166Updated this week
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆131Updated 9 months ago
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆293Updated 4 months ago
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆81Updated last year
• AI-Study-Han / Zero-Chatgpt
  从0开始，将chatgpt的技术路线跑一遍。
  ☆238Updated 9 months ago
• liguodongiot / ai-system
  LLM/MLOps/LLMOps
  ☆88Updated last week
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆124Updated 5 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆281Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆127Updated last month
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆588Updated 6 months ago
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆371Updated this week
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆75Updated 3 weeks ago
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆580Updated last year
• Tlntin / qwen-ascend-llm
  ☆44Updated 7 months ago
• BestAnHongjun / LMDeploy-Jetson
  Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…
  ☆96Updated last year
• wangshuai09 / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆37Updated 4 months ago
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆53Updated 6 months ago
• open-chinese / alpaca-chinese-dataset
  Alpaca Chinese Dataset -- 中文指令微调数据集
  ☆205Updated 8 months ago
• REXWindW / my_llm
  尝试自己从头写一个LLM，参考llama和nanogpt
  ☆62Updated last year
• FlagOpen / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆333Updated last week
• vllm-project / vllm-ascend
  Community maintained hardware plugin for vLLM on Ascend
  ☆721Updated this week
• yongzhuo / qwen2-sft
  Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理
  ☆62Updated last year
• pcg-mlp / KsanaLLM
  ☆332Updated 4 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆71Updated last month
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆216Updated this week
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆426Updated this week