Alternatives and similar repositories for handout

Users that are interested in handout are comparing it to the libraries listed below

• xgqdut2016 / hpc2torch
  ☆30Updated 2 weeks ago
• InfiniTensor / InfiniLM-Rust
  ☆125Updated last week
• xgqdut2016 / cuda_code
  easy cuda code
  ☆95Updated last year
• YdrMaster / notebook
  笔记
  ☆49Updated 5 months ago
• LearningInfiniTensor / learning-cxx
  ☆69Updated last year
• InfiniTensor / InfiniTensor
  ☆285Updated last week
• InfiniTensor / operators
  算子库
  ☆17Updated 6 months ago
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆79Updated 11 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆102Updated last month
• gogongxt / nano-sglang
  ☆116Updated 3 weeks ago
• LDLINGLINGLING / nano_vllm_note
  注释的nano_vllm仓库，并且完成了MiniCPM4的适配以及注册新模型的功能
  ☆155Updated 5 months ago
• AdvancedCompiler / AdvancedCompiler
  先进编译实验室的个人主页
  ☆195Updated 3 months ago
• alexshuang / write-your-own-ai-compiler
  《自己动手写AI编译器》
  ☆33Updated last year
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆64Updated last year
• keith2018 / TinyGPT
  Tiny C++ LLM inference implementation from scratch
  ☆100Updated this week
• InfiniTensor / ninetoothed
  A domain-specific language (DSL) based on Triton but providing higher-level abstractions.
  ☆39Updated last week
• flagos-ai / FlagTree
  FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…
  ☆197Updated last week
• GetUpEarlier / minit
  ☆28Updated last year
• xgqdut2016 / hpc_project
  some hpc project for learning
  ☆26Updated last year
• l1nkr / DL-Compiler-Navigation
  Machine Learning Compiler Road Map
  ☆46Updated 2 years ago
• array2d / deepx
  Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …
  ☆55Updated this week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆169Updated 3 weeks ago
• Infrasys-AI / infrasys-ai.github.io
  AIInfra 和 AISystem开源课程项目
  ☆36Updated 7 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆225Updated 3 weeks ago
• LearningInfiniTensor / learning-lm-rs
  ☆67Updated last year
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆76Updated 3 years ago
• InfiniTensor / Learning-CUDA
  InfiniTensor 大模型与人工智能系统训练营 CUDA 方向作业与项目系统
  ☆30Updated last week
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆158Updated 2 years ago
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆248Updated 2 weeks ago
• LearningInfiniTensor / TinyInfiniTensor
  ☆42Updated last year