学习与实践 CUDA Kernel 优化的示例仓库，涵盖矩阵乘法（SGEMM）、矩阵转置、各类归约（sum/max/softmax/矩阵 softmax）、GEMV、逐元素算子、LayerNorm，以及 cuBLAS 对比与若干入门示例。目标是以循序渐进的方式，拆解典型优化技巧并给出可复现实验。
☆38Aug 20, 2025Updated last year
Alternatives and similar repositories for CUDA_Kernel_Learn
Users that are interested in CUDA_Kernel_Learn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Aug 24, 2026Updated 2 months ago
- ☆23Jun 14, 2026Updated 4 months ago
- Lightweight LLM inference engine inspired by nano-vllm, with radix-tree based prefix cache, tp & pp, cuda graph, openai api, async schedu…☆17Mar 29, 2026Updated 7 months ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- ☆40Apr 7, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A tutorial of model quantization using TensorFlow☆11Aug 2, 2021Updated 5 years ago
- Notes for torch maintainers/modders☆10Mar 29, 2016Updated 10 years ago
- Code for phase recovery in MadTwinNet for monaural singing voice separation☆12Jul 17, 2018Updated 8 years ago
- Z项目系列-埋点SDK☆20Jul 25, 2026Updated 3 months ago
- 🍎 One kernel a day keeps high latency away. A hands-on CUDA learning path featuring a rich collection of kernels, from the basics to pea…☆233Aug 29, 2026Updated 2 months ago
- hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等☆779Apr 27, 2026Updated 6 months ago
- The official implement of "Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings"☆18Dec 5, 2024Updated last year
- The updated version of TDAA model.☆14Jul 2, 2020Updated 6 years ago
- 高性能 高精度 大陆车牌、港澳车牌、台湾车牌 韩国车牌(South Korea LPR)识别 代码开源(ncnn移植）☆50Nov 5, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Using ncnn to test the reasoning performance of neural network☆39Jan 18, 2026Updated 9 months ago
- NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 application for YOLO-Face models☆81Oct 13, 2025Updated last year
- RLVR training for LLM in CUDA/C++☆42Jul 25, 2026Updated 3 months ago
- ☆37Aug 31, 2026Updated 2 months ago
- Neural machine translation with Recurrent Deterministic Policy Gradient☆10Aug 18, 2016Updated 10 years ago
- A single-file educational implementation for understanding vLLM's core concepts and running LLM inference.☆47Apr 7, 2026Updated 6 months ago
- Automate the 'Image Assets' menu, easy to integrate into any CI pipeline.☆10Jul 29, 2023Updated 3 years ago
- Data mining project to predict stock prices on basis of sentiments.☆11Apr 2, 2016Updated 10 years ago
- CUDA & Triton Learning Project: Flash Attention 实现探索☆44Aug 14, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Mar 7, 2025Updated last year
- ☆28Oct 21, 2020Updated 6 years ago
- A Deep Reinforcement Learning model for high volume and frequency Forex Portfolio Management☆13Jan 11, 2023Updated 3 years ago
- Topic Evolution Analysis - an algorithm for analyzing knowledge flow in text based corpora☆14Oct 16, 2016Updated 10 years ago
- init to record my learning path of AI Infra, especially on inference.☆329Oct 28, 2026Updated last week
- BovDB: Open-access stock quotes dataset for Machine Learning on all B3 equities (1995–present). Daily OHLCV and Intraday.☆10Aug 25, 2026Updated 2 months ago
- GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keyword or phrase. It returns the results as a…☆14Aug 19, 2023Updated 3 years ago
- Network-faithful simulation of LLM serving and training deployments☆51Oct 8, 2026Updated 3 weeks ago
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆224Mar 18, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- UI-MOPD Official Implementation☆62Aug 10, 2026Updated 2 months ago
- ☆26Jul 1, 2023Updated 3 years ago
- A ChatGPT plugin to drive headless browser on Node.js☆10Sep 28, 2023Updated 3 years ago
- Robust and Memory Efficient Event Detection and Tracking in Large News Feeds☆13Oct 15, 2021Updated 5 years ago
- [WACV2022] Official Code for the "DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks"☆27Feb 19, 2024Updated 2 years ago
- Finance News Crawler uses News API to fetch some latest articles and generates a sentiment report with the OpenAI API or VADER☆13Aug 31, 2026Updated 2 months ago
- CS144 Lab Assignments☆45Oct 14, 2023Updated 3 years ago