Alternatives and similar repositories for tutorial_on_musa

Users that are interested in tutorial_on_musa are comparing it to the libraries listed below

• MooreThreads / torch_musa
  torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics c…
  ☆475Updated this week
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆483Updated last week
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆344Updated 3 months ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆266Updated 2 weeks ago
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆101Updated this week
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆227Updated last week
• MooreThreads / mutlass
  MUSA Templates for Linear Algebra Subroutines
  ☆41Updated last week
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆79Updated 8 months ago
• doorteeth / learn_cuda
  ☆43Updated 4 years ago
• Liu-xiandong / How_to_optimize_in_GPU
  This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…
  ☆1,233Updated 2 years ago
• Kedreamix / pytorch-cppcuda-tutorial
  tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)
  ☆29Updated 2 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆170Updated 2 weeks ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆367Updated 2 years ago
• RussWong / CUDATutorial
  A CUDA tutorial to make people learn CUDA program from 0
  ☆266Updated last year
• microsoft / T-MAC
  Low-bit LLM inference on CPU/NPU with lookup table
  ☆916Updated 8 months ago
• MooreThreads / vllm_musa
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated last year
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆111Updated this week
• NVIDIA / cudnn-frontend
  cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it
  ☆682Updated last week
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆749Updated last year
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆1,037Updated last week
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆616Updated last year
• HeKun-NVIDIA / TensorRT-Developer_Guide_in_Chinese
  ☆314Updated 3 years ago
• Deep-Spark / DeepSparkHub
  DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…
  ☆70Updated last week
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆520Updated last year
• ifromeast / cuda_learning
  learning how CUDA works
  ☆373Updated 11 months ago
• ModelTC / LightCompress
  [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
  ☆672Updated 2 months ago
• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆225Updated last year
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆274Updated 6 months ago
• RussWong / LLM-engineering
  ☆26Updated 5 months ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆171Updated last month