Alternatives and similar repositories for README:

Users that are interested in README are comparing it to the libraries listed below

• CalvinXKY / BasicCUDA
  A tutorial for CUDA&PyTorch
  ☆126Updated 3 weeks ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆77Updated last month
• AyakaGEMM / Hands-on-GEMM
  ☆108Updated 10 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆93Updated 11 months ago
• hyperai / triton-cn
  Triton Documentation in Chinese Simplified / Triton 中文文档
  ☆53Updated last month
• ifromeast / cuda_learning
  learning how CUDA works
  ☆197Updated 6 months ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆56Updated last week
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆217Updated this week
• sunkx109 / llama
  Inference code for LLaMA models
  ☆113Updated last year
• MAhaitao999 / CUDA_Programming
  《CUDA编程基础与实践》一书的代码
  ☆106Updated 2 years ago
• sunkx109 / My-Torch-Extension
  A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.
  ☆31Updated 10 months ago
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆392Updated 10 months ago
• Tongkaio / CUDA_Kernel_Samples
  CUDA 算子手撕与面试指南
  ☆147Updated last month
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆109Updated this week
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆44Updated 3 months ago
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆124Updated 6 months ago
• caixiongjiang / HPC
  高性能计算课程&CUDA编程实例&深度学习推理框架
  ☆36Updated last year
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆46Updated 7 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆128Updated last year
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆299Updated this week
• Oldpan / DeployIsAllYouNeed
  ☆120Updated last year
• madsys-dev / deepseekv2-profile
  ☆97Updated 6 months ago
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆103Updated this week
• datawhalechina / awesome-compression
  模型压缩的小白入门教程
  ☆236Updated 2 months ago
• xiatwhu / baidu_topk
  ☆13Updated last year
• harleyszhang / llm_note
  LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
  ☆473Updated this week
• harleyszhang / lite_llama
  A light llama-like llm inference framework based on the triton kernel.
  ☆83Updated this week
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆391Updated 6 months ago
• tingshua-yts / BetterDL
  ☆33Updated last year