☆22Aug 14, 2024Updated last year
Alternatives and similar repositories for cute_gemm
Users that are interested in cute_gemm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆82Aug 12, 2024Updated last year
- 使用 cutlass 实现 flash-attention 精简版，具有教学意义☆59Aug 12, 2024Updated last year
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated 11 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆32Updated this week
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆37Sep 15, 2023Updated 2 years ago
- ☆186May 11, 2026Updated 2 months ago
- CUTLASS and CuTe Examples☆136Nov 30, 2025Updated 7 months ago
- flash attention tutorial written in python, triton, cuda, cutlass☆527Jan 20, 2026Updated 6 months ago
- ☆14Nov 3, 2025Updated 8 months ago
- ☆52May 19, 2025Updated last year
- Whisper in TensorRT-LLM☆17Sep 21, 2023Updated 2 years ago
- ☆156Mar 4, 2025Updated last year
- ☆269Jul 11, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆65Apr 26, 2025Updated last year
- ☆13Jun 18, 2024Updated 2 years ago
- Optimize softmax in triton in many cases☆24Sep 6, 2024Updated last year
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆45Feb 27, 2025Updated last year
- TensorRT encapsulation, learn, rewrite, practice.☆30Oct 19, 2022Updated 3 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated last year
- ☆121May 16, 2025Updated last year
- ☆26Feb 17, 2025Updated last year
- CPU Memory Compiler and Parallel programing☆26Nov 18, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Lightweight Python Wrapper for OpenVINO, enabling LLM inference on NPUs☆29Dec 17, 2024Updated last year
- A direct convolution library targeting ARM multi-core CPUs.☆12Nov 27, 2024Updated last year
- SGLang kernel library for Intel XPU☆27Updated this week
- NVFP4 Flash-Attention 4 on BlackWell☆28Updated this week
- A simple high performance CUDA GEMM implementation.☆437Jan 4, 2024Updated 2 years ago
- A Top-Down Profiler for GPU Applications☆23Feb 29, 2024Updated 2 years ago
- ☆12Mar 13, 2023Updated 3 years ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆11Jul 27, 2024Updated last year
- Simple and efficient memory pool is implemented with C++11.☆10Jun 2, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆49Apr 15, 2024Updated 2 years ago
- ☆36Mar 31, 2025Updated last year
- LLM-powered Python☆16Apr 8, 2026Updated 3 months ago
- TTS Android demo of PaddleSpeech, merged into https://github.com/PaddlePaddle/PaddleSpeech/tree/develop/demos☆28Nov 30, 2022Updated 3 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Jun 21, 2026Updated 3 weeks ago
- Step-by-step optimization of CUDA SGEMM☆485Mar 30, 2022Updated 4 years ago
- Optimize GEMM with tensorcore step by step☆40Dec 17, 2023Updated 2 years ago