li199603/sgemm_with_cuda external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

li199603/sgemm_with_cuda

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/li199603/sgemm_with_cuda)

Close

li199603 / sgemm_with_cudaView on GitHubMore

• External links
• Readme badge

SGEMM optimization with cuda step by step

☆24Mar 23, 2024Updated 2 years ago

Alternatives and similar repositories for sgemm_with_cuda

Users that are interested in sgemm_with_cuda are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• merrymercy / Awesome-Efficient-LLM

  View on GitHub
  A curated list for Efficient Large Language Models
  ☆11Mar 25, 2024Updated 2 years ago
• li199603 / parallel_prefix_sum

  View on GitHub
  Parallel Prefix Sum (Scan) with CUDA
  ☆30Jun 22, 2024Updated 2 years ago
• Bruce-Lee-LY / cutlass_gemm

  View on GitHub
  Multiple GEMM operators are constructed with cutlass to support LLM inference.
  ☆20Aug 3, 2025Updated last year
• richjjj / cuvid-tensorrt-multi

  View on GitHub
  ffmpeg+cuvid+tensorrt+multicamera
  ☆12Dec 31, 2024Updated last year
• BBuf / tensorrt-llm-moe

  View on GitHub
  ☆34Feb 3, 2025Updated last year
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• wangzijian1010 / TensorRT-Plugin-Demo

  View on GitHub
  a repo to study TensorRT Plugin
  ☆11Apr 30, 2025Updated last year
• Yongqi-Zhuo / triton-tvm

  View on GitHub
  Triton to TVM transpiler.
  ☆24Oct 14, 2024Updated 2 years ago
• Bruce-Lee-LY / flash_attention_inference

  View on GitHub
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆46Feb 27, 2025Updated last year
• shouxieai / nerf_from_scratch

  View on GitHub
  重构nerf代码，更加容易读懂
  ☆13Mar 26, 2023Updated 3 years ago
• whhren / LLM-inference-Notes

  View on GitHub
  ☆17Oct 21, 2026Updated 2 weeks ago
• Zolewit / TNNdemo

  View on GitHub
  很好用的tnn classify demo
  ☆11Mar 24, 2021Updated 5 years ago
• coderonion / cuda-beginner-course-cpp-version

  View on GitHub
  bilibili视频【CUDA 12.x 并行编程入门(C++版)】配套代码
  ☆34Aug 12, 2024Updated 2 years ago
• hova88 / CUDA-MatMul-Practice

  View on GitHub
  ☆19Jan 4, 2024Updated 2 years ago
• KuangjuX / cu-x

  View on GitHub
  🎉My Collections of CUDA Kernels~
  ☆11Jun 25, 2024Updated 2 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• xlite-dev / qwen-image-fast

  View on GitHub
  ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs
  ☆17Oct 24, 2025Updated last year
• leoluopy / autotvm_tutorial

  View on GitHub
  autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …
  ☆31May 6, 2021Updated 5 years ago
• HenryPengZou / InterruptBench

  View on GitHub
  InterruptBench: Evaluating LLM Agents Under User Interruptions in Long-Horizon Web Tasks
  ☆17Jul 9, 2026Updated 3 months ago
• weishengying / cutlass_flash_atten_fp8

  View on GitHub
  使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention
  ☆82Aug 12, 2024Updated 2 years ago
• bearneck / cuda-programming-guide-zh

  View on GitHub
  NVIDIA CUDA Programming Guide 官方文档中文翻译版
  ☆45Mar 24, 2026Updated 7 months ago
• xlite-dev / longcat-video-fast

  View on GitHub
  🔥LongCat-Video 1.7x🎉 speedup: cache acceleration and 4/8-bits weight only.
  ☆16Oct 28, 2025Updated last year
• shouxieai / bevfusion_02hero

  View on GitHub
  ☆17Nov 14, 2023Updated 2 years ago
• dog-qiuqiu / Simple-TensorRT

  View on GitHub
  Secondary encapsulation of NVIDIA TensorRT interface to simplify the calling process
  ☆14Mar 30, 2024Updated 2 years ago
• yccm / SkillGen

  View on GitHub
  Official Implementation of Paper [NeurIPS 2026] SkillGen: Verified Inference-Time Agent Skill Synthesis
  ☆20Sep 24, 2026Updated last month
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• openmlsys / openmlsys-cuda

  View on GitHub
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆134Aug 12, 2023Updated 3 years ago
• tfruan2000 / mlsys-study-note

  View on GitHub
  My study note for mlsys
  ☆14Nov 4, 2024Updated 2 years ago
• Bruce-Lee-LY / cuda_hgemm

  View on GitHub
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆575Sep 8, 2024Updated 2 years ago
• sunkx109 / My-Torch-Extension

  View on GitHub
  A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.
  ☆40Jan 24, 2026Updated 9 months ago
• LeiWang1999 / AutoGPTQ.tvm

  View on GitHub
  GPTQ inference TVM kernel
  ☆41Apr 25, 2024Updated 2 years ago
• cqu20160901 / FastSAM_onnx_rknn

  View on GitHub
  FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。
  ☆26May 30, 2024Updated 2 years ago
• lucasjinreal / wnnx_models

  View on GitHub
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Jun 22, 2022Updated 4 years ago
• l-sf / LightTrack_openvino

  View on GitHub
  本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.
  ☆21Nov 2, 2023Updated 3 years ago
• CalebDu / Awesome-Cute

  View on GitHub
  ☆123May 16, 2025Updated last year
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• tlc-pack / libflash_attn

  View on GitHub
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆113Sep 10, 2024Updated 2 years ago
• squest / zenx-integrated-learning

  View on GitHub
  Learning problem-solving, logic/set, math, physics, economics through functional programming using Haskell
  ☆19Oct 16, 2015Updated 11 years ago
• caiwanxianhust / flash-attention-opt

  View on GitHub
  flash attention 优化日志
  ☆34Aug 28, 2026Updated 2 months ago
• xlite-dev / yolox-toolkit

  View on GitHub
  YOLOX with NCNN/MNN/TNN/ONNXRuntime C++.
  ☆13Dec 18, 2021Updated 4 years ago
• NonvolatileMemory / flash_tree_attn

  View on GitHub
  ☆20Dec 24, 2024Updated last year
• triple-mu / HunyuanDiT-TensorRT-libtorch

  View on GitHub
  HunyuanDiT with TensorRT and libtorch
  ☆18May 22, 2024Updated 2 years ago
• BBuf / flash-rwkv

  View on GitHub
  ☆32May 26, 2024Updated 2 years ago