Alternatives and similar repositories for Starter:

Users that are interested in Starter are comparing it to the libraries listed below

• PFCCLab / Camp
  飞桨护航计划集训营
  ☆19Updated this week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆60Updated 2 months ago
• sunzhongkai588 / LearnDL
  本项目为飞桨框架学习群的活动
  ☆25Updated last year
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆72Updated last month
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆48Updated 4 months ago
• sunkx109 / My-Torch-Extension
  A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.
  ☆33Updated 11 months ago
• InfiniTensor / InfiniTensor
  ☆227Updated last month
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆80Updated 2 months ago
• PaddlePaddle / community
  PaddlePaddle Developer Community
  ☆98Updated this week
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆34Updated 2 months ago
• zjhellofss / kuiperdatawhale
  ☆254Updated 5 months ago
• ZonePG / cs-notes
  my cs notes
  ☆38Updated 5 months ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆100Updated 2 weeks ago
• xgqdut2016 / cuda_code
  easy cuda code
  ☆66Updated 2 months ago
• PaddlePaddle / PaConvert
  PaddlePaddle Code Convert Toolkit. 『飞桨』深度学习代码转换工具
  ☆95Updated this week
• AyakaGEMM / Hands-on-GEMM
  ☆113Updated last year
• DefTruth / ffpa-attn-mma
  📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑🎉vs SDPA EA.
  ☆147Updated this week
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆82Updated this week
• XiaoSong9905 / dgemm-knl
  DGEMM on KNL, achieve 75% MKL
  ☆16Updated 2 years ago
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆56Updated 2 years ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆93Updated last year
• interestingLSY / CUDA-From-Correctness-To-Performance-Code
  Codes & examples for "CUDA - From Correctness to Performance"
  ☆87Updated 4 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆129Updated last year
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆71Updated 3 months ago
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆309Updated last week
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆128Updated 2 months ago
• tongzhou80 / nanoPyC
  ☆70Updated 2 years ago
• Tongkaio / CUDA_Kernel_Samples
  CUDA 算子手撕与面试指南
  ☆225Updated 2 months ago
• PFCCLab / paddlefx
  An experimental project for paddle python IR.
  ☆15Updated last year
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆64Updated last week