Alternatives and similar repositories for nano_vllm_note

Users that are interested in nano_vllm_note are comparing it to the libraries listed below

• serdes21 / flashtile

  View on GitHub
  FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.
  ☆37Feb 6, 2026Updated last week
• simveit / persistent_dense_gemm

  View on GitHub
  Persistent dense gemm for Hopper in `CuTeDSL`
  ☆15Aug 9, 2025Updated 6 months ago
• ACA-Lab-SJTU / token-ring

  View on GitHub
  ☆13Jan 7, 2025Updated last year
• NJUDeepEngine / CAEF

  View on GitHub
  Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"
  ☆11Oct 11, 2024Updated last year
• foundation-model-stack / vllm-triton-backend

  View on GitHub
  A Triton-only attention backend for vLLM
  ☆23Updated this week
• aws-neuron / nki-library

  View on GitHub
  ☆42Jan 24, 2026Updated 3 weeks ago
• HuPengsheet / EasyNN

  View on GitHub
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆37Aug 26, 2024Updated last year
• harleyszhang / lite_llama

  View on GitHub
  A light llama-like llm inference framework based on the triton kernel.
  ☆171Jan 5, 2026Updated last month
• cherichy / tilecute

  View on GitHub
  ☆32Jul 2, 2025Updated 7 months ago
• l-sf / Nanodet_openvino_quant_deploy

  View on GitHub
  本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！
  ☆16Jun 14, 2023Updated 2 years ago
• zhangkai0425 / SGEMM-HPC

  View on GitHub
  Implementation and optimization of matrix multiplication on single CPU (HPC-THU-2023-Autumn)
  ☆18Feb 27, 2024Updated last year
• ai-glimpse / toyllm

  View on GitHub
  ToyLLM: Learning LLM from Scratch
  ☆25Jan 26, 2026Updated 2 weeks ago
• Snektron / gpumode-amd-fp8-mm

  View on GitHub
  My submission for the GPUMODE/AMD fp8 mm challenge
  ☆29Jun 4, 2025Updated 8 months ago
• yester31 / Cutlass_EX

  View on GitHub
  study of cutlass
  ☆22Nov 10, 2024Updated last year
• luliyucoordinate / cute-flash-attention

  View on GitHub
  Implement Flash Attention using Cute.
  ☆100Dec 17, 2024Updated last year
• JohndeVostok / APE

  View on GitHub
  A GPU FP32 computation method with Tensor Cores.
  ☆26Dec 8, 2025Updated 2 months ago
• muriloboratto / NVSHEMEM

  View on GitHub
  Sample Codes using NVSHMEM on Multi-GPU
  ☆30Jan 22, 2023Updated 3 years ago
• CalebDu / Awesome-Cute

  View on GitHub
  ☆114May 16, 2025Updated 8 months ago
• xxyux / SpInfer

  View on GitHub
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆61Mar 25, 2025Updated 10 months ago
• HPMLL / NVIDIA-Hopper-Benchmark

  View on GitHub
  ☆88May 31, 2025Updated 8 months ago
• iclementine / optimize_softmax

  View on GitHub
  Optimize softmax in triton in many cases
  ☆22Sep 6, 2024Updated last year
• flashinfer-ai / cutlass-viz

  View on GitHub
  ☆65Apr 26, 2025Updated 9 months ago
• phonism / genesis

  View on GitHub
  Gensis is a lightweight deep learning framework written from scratch in Python, with Triton as its backend for high-performance computing…
  ☆37Jan 15, 2026Updated 3 weeks ago
• KuangjuX / AttnLink

  View on GitHub
  An experimental communicating attention kernel based on DeepEP.
  ☆35Jul 29, 2025Updated 6 months ago
• xgqdut2016 / hpc_project

  View on GitHub
  some hpc project for learning
  ☆26Aug 28, 2024Updated last year
• ouyanghaodong / DEYOv1.5

  View on GitHub
  DEYOv1.5
  ☆29Jul 22, 2024Updated last year
• Bruce-Lee-LY / cuda_hgemv

  View on GitHub
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆72Sep 8, 2024Updated last year
• eth-cscs / Tiled-MM

  View on GitHub
  Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.
  ☆32Apr 2, 2025Updated 10 months ago
• preacher-1 / MLA_tutorial

  View on GitHub
  from MHA, MQA, GQA to MLA by 苏剑林, with code
  ☆41Feb 19, 2025Updated 11 months ago
• KMnO4-zx / tiny-llm

  View on GitHub
  ☆32Jul 8, 2025Updated 7 months ago
• NYCU-AI-EDA / Netlistify

  View on GitHub
  ☆26Dec 3, 2025Updated 2 months ago
• VimalWill / Vstream

  View on GitHub
  Vstream - Video Analytics pipeline with Hardware based accelerations (dev - stage)
  ☆10Feb 2, 2024Updated 2 years ago
• gty111 / GEMM_MMA

  View on GitHub
  Optimize GEMM with tensorcore step by step
  ☆36Dec 17, 2023Updated 2 years ago
• SeungHwi0613 / ros2_bevfusion_demo

  View on GitHub
  ☆31Aug 25, 2023Updated 2 years ago
• zjhellofss / triton_course

  View on GitHub
  ☆40May 11, 2025Updated 9 months ago
• Quongboo / KG-RAG-FOR-ARCH

  View on GitHub
  针对建筑规范文本数据的知识图谱实体关系提取，知识图谱构建，检索增强生成DEMO
  ☆35Aug 7, 2024Updated last year
• ademeure / cuda-side-boost

  View on GitHub
  ☆54May 5, 2025Updated 9 months ago
• mdy666 / mdy_triton

  View on GitHub
  ☆152Jul 4, 2025Updated 7 months ago
• InfiniTensor / InfiniTrain

  View on GitHub
  ☆17Updated this week