Alternatives and similar repositories for ascend-llm

Users that are interested in ascend-llm are comparing it to the libraries listed below

• Tlntin / qwen-ascend-llm
  ☆44Updated 7 months ago
• BestAnHongjun / LMDeploy-Jetson
  Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…
  ☆96Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• owenliang / mnist-onnx-runtime
  MoE model with onnx runtime
  ☆45Updated last year
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆61Updated 9 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆71Updated 2 months ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆220Updated this week
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆48Updated last year
• sunkx109 / llama
  Inference code for LLaMA models
  ☆121Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆80Updated last month
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆128Updated last week
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆131Updated 10 months ago
• lenLRX / llm_simple
  ☆12Updated 3 weeks ago
• sophgo / sophon-pipeline
  ☆41Updated 11 months ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆107Updated last week
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆35Updated 5 months ago
• xzyun2011 / wulewule
  基于InterLM的《黑神话：悟空》AI小助手，了解更多背后的故事--在更新视频中
  ☆31Updated 5 months ago
• sophon-ai-algo / examples
  Examples for SophonSDK
  ☆106Updated 2 years ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆57Updated 7 months ago
• ZRayZzz / flash-attention-v100
  ☆45Updated last year
• RethinkFun / trian_ppo
  ☆82Updated 8 months ago
• zjhellofss / triton_course
  ☆28Updated last month
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆85Updated this week
• preacher-1 / MLA_tutorial
  from MHA, MQA, GQA to MLA by 苏剑林, with code
  ☆22Updated 4 months ago
• heyongxin233 / YOLO-Pruning-RKNN
  Easy Training Official YOLOv8、YOLOv7、YOLOv6、YOLOv5 and Prune all_model using Torch-Pruning!
  ☆65Updated last year
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• mindspore-lab / mindyolo
  A toolbox of yolo models and algorithms based on MindSpore
  ☆134Updated 2 months ago
• thb1314 / mmyolo_tensorrt
  ☆139Updated last year
• Oneflow-Inc / oneflow-yolo-doc
  https://start.oneflow.org/oneflow-yolo-doc
  ☆22Updated 2 years ago