Alternatives and similar repositories for Starter

Users that are interested in Starter are comparing it to the libraries listed below

• PFCCLab / Camp
  飞桨护航计划集训营
  ☆18Updated last month
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆71Updated 2 months ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆57Updated 7 months ago
• ZonePG / cs-notes
  my cs notes
  ☆51Updated 8 months ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆128Updated last week
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆73Updated 4 months ago
• dlsyscourse / hw2
  ☆8Updated 8 months ago
• Chtholly-Boss / swizzle
  A practical way of learning Swizzle
  ☆20Updated 4 months ago
• sunzhongkai588 / LearnDL
  本项目为飞桨框架学习群的活动
  ☆25Updated 2 years ago
• PaddlePaddle / PaConvert
  PaddlePaddle Code Convert Toolkit. 『飞桨』深度学习代码转换工具
  ☆106Updated last week
• AyakaGEMM / Hands-on-GEMM
  ☆135Updated last year
• PKUFlyingPig / MIT6.5940_TinyML
  Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing
  ☆47Updated 5 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆96Updated last week
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆38Updated 2 weeks ago
• InfiniTensor / InfiniTensor
  ☆235Updated last week
• zjhellofss / triton_course
  ☆28Updated last month
• PaddlePaddle / community
  PaddlePaddle Developer Community
  ☆113Updated last week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• xlite-dev / ffpa-attn
  ⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.
  ☆186Updated last month
• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆146Updated 5 months ago
• xgqdut2016 / cuda_code
  easy cuda code
  ☆75Updated 6 months ago
• PKU-SEC-Lab / HybriMoE
  [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"
  ☆54Updated 2 weeks ago
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆85Updated this week
• sunkx109 / My-Torch-Extension
  A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.
  ☆33Updated last year
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆63Updated 2 years ago
• xgqdut2016 / hpc_project
  some hpc project for learning
  ☆22Updated 9 months ago
• zjhellofss / kuiperdatawhale
  ☆278Updated 8 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆87Updated 6 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆77Updated 3 weeks ago