Step by step implementation of a fast softmax kernel in CUDA
☆72Jan 6, 2025Updated last year
Alternatives and similar repositories for FastSoftmax
Users that are interested in FastSoftmax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆101May 30, 2026Updated 5 months ago
- A collection of GPU experiments and benchmarks for my personal understanding and research.☆43Aug 19, 2026Updated 2 months ago
- Tensara's GPU programming problems☆20Apr 23, 2026Updated 6 months ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆26Nov 15, 2024Updated last year
- learn TensorRT from scratch🥰☆18Sep 29, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.☆30Updated this week
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- Fast CUDA matrix multiplication from scratch☆1,356Sep 2, 2025Updated last year
- ☆24Oct 13, 2026Updated 3 weeks ago
- ☆18Mar 12, 2025Updated last year
- RISC-V Rocket Chip Strap-on-Booster with Fused Universal Neural Network (FuNN) eNNgine☆21Mar 17, 2022Updated 4 years ago
- ☆15Oct 2, 2025Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- This example starts with a simple sum reduction in CUDA, then steps through a series of optimizations we can perform to improve its perfo…☆14Jun 8, 2020Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Hand-Rolled GPU communications library☆95Nov 25, 2025Updated 11 months ago
- CUDA Matrix Multiplication Optimization☆283Jul 19, 2024Updated 2 years ago
- Flash Attention in ~100 lines of CUDA (forward pass only)☆12Jun 10, 2024Updated 2 years ago
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated 2 years ago
- A simple docker compose setup that works (in limited testing) on Blackwell cards☆17Oct 13, 2025Updated last year
- Code Implementation for OSCAR 2026 Workshop: Toward Sustainable GPU Modeling: Autonomous Micro-benchmarking with LLM Agents☆16Jun 28, 2026Updated 4 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 8 months ago
- Step-by-step optimization of CUDA SGEMM☆525Mar 30, 2022Updated 4 years ago
- Open-source web-based GPU performance visualization tool that transforms NVIDIA profiling data into interactive insights for CUDA enginee…☆13Aug 29, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- a ai infra framework for edge device base on nndeploy☆17Nov 27, 2025Updated 11 months ago
- An Optimizer for Nvidia Compilers.☆146Oct 21, 2026Updated 2 weeks ago
- llama INT4 cuda inference with AWQ☆55Jan 20, 2025Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 3 years ago
- FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving☆12Aug 3, 2026Updated 3 months ago
- TensorRT-in-Action 是一个 GitHub 代码库，提供了使用 TensorRT 的代码示例，并有对应 Jupyter Notebook。☆15Jun 1, 2023Updated 3 years ago
- GPU Microcontroller Compiler☆26Jul 14, 2013Updated 13 years ago
- 使用mnn-llm对GOT-OCR2.0进行推理☆13Oct 2, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆14Nov 3, 2025Updated last year
- Super fast FP32 matrix multiplication on RDNA3☆93Mar 30, 2025Updated last year
- Flash Attention in raw Cuda C beating PyTorch☆39May 14, 2024Updated 2 years ago
- ☆129May 31, 2025Updated last year
- ACPO: Python ML training/inference framework for LLVM optimizations☆15Jul 2, 2025Updated last year
- Quartet II Official Code☆85May 1, 2026Updated 6 months ago
- Code for recording warp timing in OpenGL 4.5 on NVIDIA hardware☆30Jul 29, 2016Updated 10 years ago