NVIDIA / cuda-pythonLinks
CUDA Python: Performance meets Productivity
☆2,969Updated this week
Alternatives and similar repositories for cuda-python
Users that are interested in cuda-python are comparing it to the libraries listed below
Sorting:
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,729Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,361Updated this week
- CUDA Library Samples☆2,101Updated last week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,519Updated this week
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,372Updated this week
- CUDA Templates for Linear Algebra Subroutines☆8,468Updated this week
- FlashInfer: Kernel Library for LLM Serving☆3,761Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆4,997Updated this week
- CUDA Core Compute Libraries☆1,918Updated this week
- Tile primitives for speedy kernels☆2,704Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆1,632Updated this week
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆1,805Updated this week
- CUDA integration for Python, plus shiny features☆1,986Updated last week
- A PyTorch native platform for training generative AI models☆4,395Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,861Updated this week
- NVIDIA curated collection of educational resources related to general purpose GPU programming.☆704Updated 3 weeks ago
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,411Updated this week
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,114Updated 3 weeks ago
- Supercharge Your LLM with the Fastest KV Cache Layer☆5,338Updated this week
- A Python framework for accelerated simulation, data generation and spatial computing.☆5,523Updated this week
- NumPy and SciPy on Multi-Node Multi-GPU systems☆932Updated last week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,492Updated this week
- Optimized primitives for collective multi-GPU communication☆4,051Updated this week
- NVIDIA Math Libraries for the Python Ecosystem☆387Updated 2 weeks ago
- GPU programming related news and material links☆1,695Updated this week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,061Updated last year
- Puzzles for learning Triton☆1,992Updated 10 months ago
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆986Updated last week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆5,715Updated last week
- how to optimize some algorithm in cuda.☆2,473Updated this week