Alternatives and similar repositories for handout

Users that are interested in handout are comparing it to the libraries listed below

• YdrMaster / notebook
  笔记
  ☆50Updated 5 months ago
• InfiniTensor / InfiniLM-Rust
  ☆126Updated 2 weeks ago
• xgqdut2016 / hpc2torch
  ☆30Updated 3 weeks ago
• LearningInfiniTensor / learning-cxx
  ☆69Updated last year
• xgqdut2016 / cuda_code
  easy cuda code
  ☆95Updated last year
• InfiniTensor / InfiniTensor
  ☆285Updated last week
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆102Updated last month
• InfiniTensor / RefactorGraph
  分层解耦的深度学习推理引擎
  ☆79Updated 11 months ago
• InfiniTensor / operators
  算子库
  ☆17Updated 6 months ago
• flagos-ai / FlagTree
  FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…
  ☆200Updated this week
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆64Updated last year
• YuxueYang1204 / CudaDemo
  Implement custom operators in PyTorch with cuda/c++
  ☆76Updated 3 years ago
• AdvancedCompiler / AdvancedCompiler
  先进编译实验室的个人主页
  ☆195Updated 3 months ago
• keith2018 / TinyGPT
  Tiny C++ LLM inference implementation from scratch
  ☆102Updated last week
• array2d / deepx
  Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & …
  ☆55Updated last week
• sunkx109 / llama.cpp
  llama 2 Inference
  ☆43Updated 2 years ago
• lzyrapx / LeetGPU
  🌈 Solutions of LeetGPU
  ☆70Updated last week
• InfiniTensor / ninetoothed
  A domain-specific language (DSL) based on Triton but providing higher-level abstractions.
  ☆41Updated this week
• xgqdut2016 / hpc_project
  some hpc project for learning
  ☆26Updated last year
• phonism / genesis
  Gensis is a lightweight deep learning framework written from scratch in Python, with Triton as its backend for high-performance computing…
  ☆37Updated 3 weeks ago
• LearningInfiniTensor / learning-lm-rs
  ☆67Updated last year
• gogongxt / nano-sglang
  ☆116Updated 3 weeks ago
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆171Updated last month
• flagos-ai / FlagCX
  FlagCX is a scalable and adaptive cross-chip communication library.
  ☆170Updated last week
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆248Updated 2 weeks ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆225Updated 3 weeks ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆136Updated 2 years ago
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆49Updated 2 years ago
• apache / tvm-ffi
  Open ABI and FFI for Machine Learning Systems
  ☆313Updated last week
• tongzhou80 / nanoPyC
  ☆69Updated 2 years ago