Alternatives and similar repositories for tutorial_on_musa

Users that are interested in tutorial_on_musa are comparing it to the libraries listed below

• MooreThreads / torch_musa
  torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics c…
  ☆440Updated 2 weeks ago
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆320Updated last week
• DataXujing / TensorRT-LLM-ChatGLM3
  大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM
  ☆26Updated last year
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆253Updated this week
• MooreThreads / vllm_musa
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆65Updated last year
• ChambinLee / CUDA_with_PyTorch
  这个项目介绍了简单的CUDA入门，涉及到CUDA执行模型、线程层次、CUDA内存模型、核函数的编写方式以及PyTorch使用CUDA扩展的两种方式。通过该项目可以基本入门基于PyTorch的CUDA扩展的开发方式。
  ☆94Updated 3 years ago
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆449Updated this week
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated this week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆160Updated last month
• li199603 / parallel_prefix_sum
  Parallel Prefix Sum (Scan) with CUDA
  ☆27Updated last year
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆69Updated last week
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆159Updated 9 months ago
• OpenPPL / ppl.cv
  ppl.cv is a high-performance image processing library of openPPL supporting various platforms.
  ☆511Updated last year
• sophgo / tpu-mlir
  Machine learning compiler based on MLIR for Sophgo TPU.
  ☆812Updated this week
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆97Updated this week
• OpenPPL / ppl.pmx
  ☆59Updated 11 months ago
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆1,173Updated 2 years ago
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆50Updated last year
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆163Updated last month
• ischintsan / cuda_by_example
  GPU高性能编程CUDA实战随书代码
  ☆40Updated 3 years ago
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆301Updated 3 years ago
• MAhaitao999 / CUDA_Programming
  《CUDA编程基础与实践》一书的代码
  ☆139Updated 3 years ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆367Updated 2 years ago
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆71Updated 5 months ago
• nndeploy / nndeploy
  An Easy-to-Use and High-Performance AI Deployment Framework | 一款简单易用且高性能的AI部署框架
  ☆1,246Updated this week
• PaddlePaddle / PaConvert
  PaddlePaddle Code Convert Toolkit. 『飞桨』深度学习代码转换工具
  ☆117Updated last week
• Tlntin / qwen-ascend-llm
  ☆51Updated last year
• sunkx109 / llama.cpp
  llama 2 Inference
  ☆43Updated 2 years ago
• piDack / The-ans-for-Programming-Massively-Parallel-Processor
  大规模并行处理器编程实战 第二版答案
  ☆33Updated 3 years ago
• FlagOpen / FlagPerf
  FlagPerf is an open-source software platform for benchmarking AI chips.
  ☆352Updated 2 weeks ago