CUDA SGEMM optimization note
☆15Oct 31, 2023Updated 2 years ago
Alternatives and similar repositories for cuda-sgemm-optimization
Users that are interested in cuda-sgemm-optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🎉My Collections of CUDA Kernels~☆11Jun 25, 2024Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated 8 months ago
- TileGraph is an experimental DNN compiler that utilizes static code generation and kernel fusion techniques.☆11Sep 18, 2024Updated last year
- ☆15May 30, 2019Updated 6 years ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Flash Attention in ~100 lines of CUDA (forward pass only)☆12Jun 10, 2024Updated last year
- ☆18May 10, 2023Updated 2 years ago
- A CUDA kernel optimization toolkit for validation, benchmarking, Nsight Compute profiling, bottleneck analysis, and iterative tuning. It …☆146Apr 22, 2026Updated last week
- Implement FlashAttention v2 with minimal code to learn.☆16Jun 12, 2024Updated last year
- ☆12Feb 7, 2018Updated 8 years ago
- ☆15Oct 9, 2022Updated 3 years ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆180Feb 11, 2026Updated 2 months ago
- Step-by-step optimization of CUDA SGEMM☆460Mar 30, 2022Updated 4 years ago
- E-Graph library☆22Apr 4, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Estimate depth from surface normal.☆12Aug 14, 2020Updated 5 years ago
- ☆27May 27, 2024Updated last year
- Read audio with FFmpeg into NumPy/PyTorch via ctypes (standard library module)☆11Aug 12, 2020Updated 5 years ago
- ☆15Dec 1, 2023Updated 2 years ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆23Nov 15, 2024Updated last year
- A graph coloring register allocator for LLVM.☆11Jan 23, 2017Updated 9 years ago
- Sequence-level 1F1B schedule for LLMs.☆37Aug 26, 2025Updated 8 months ago
- 5th place solution in "NIPS 2017: Non-targeted Adversarial Attack" (with solution in targeted attack and defence)☆10Nov 14, 2017Updated 8 years ago
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆179Nov 11, 2025Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- OSDI 2023 Welder, deeplearning compiler☆33Nov 24, 2023Updated 2 years ago
- ☆122Apr 16, 2026Updated 2 weeks ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆46Jun 11, 2025Updated 10 months ago
- Md5 碰撞生成实现，去掉了boost依赖，简化编译☆12Jan 25, 2018Updated 8 years ago
- ☆20May 24, 2025Updated 11 months ago
- A concurrent LRU cache.☆23Feb 14, 2021Updated 5 years ago
- Embedding-based real-time change point detection with application to activity segmentation in smart home time series data☆16Nov 20, 2022Updated 3 years ago
- DiscreteTom's Blog Boilerplate.☆10Mar 6, 2023Updated 3 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆16Aug 31, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆32Apr 2, 2025Updated last year
- Fast and memory-efficient exact attention☆31Dec 2, 2024Updated last year
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated 2 months ago
- OCRFusion is an integrated solution that combines multiple open-source OCR (Optical Character Recognition) models, layout analysis, and t…☆16Jul 30, 2024Updated last year
- Markdown to LaTeX☆19Jul 29, 2022Updated 3 years ago
- Transformers components but in Triton☆34May 9, 2025Updated 11 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆91Feb 14, 2026Updated 2 months ago