NVIDIA / cuda-pythonLinks
CUDA Python: Performance meets Productivity
☆3,082Updated this week
Alternatives and similar repositories for cuda-python
Users that are interested in cuda-python are comparing it to the libraries listed below
Sorting:
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆2,993Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,560Updated this week
- CUDA Library Samples☆2,240Updated this week
- cuTile is a programming model for writing parallel kernels for NVIDIA GPUs☆523Updated last week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆4,113Updated this week
- NVIDIA curated collection of educational resources related to general purpose GPU programming.☆968Updated this week
- CUDA Core Compute Libraries☆2,060Updated last week
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,637Updated this week
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆8,950Updated this week
- FlashInfer: Kernel Library for LLM Serving☆4,195Updated this week
- NVIDIA Math Libraries for the Python Ecosystem☆540Updated 3 weeks ago
- Tile primitives for speedy kernels☆2,994Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,794Updated this week
- NumPy and SciPy on Multi-Node Multi-GPU systems☆959Updated last week
- A Datacenter Scale Distributed Inference Serving Framework☆5,617Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,543Updated this week
- CUDA integration for Python, plus shiny features☆2,009Updated last week
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆1,981Updated this week
- Optimized primitives for collective multi-GPU communication☆4,289Updated last week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,904Updated this week
- A Python framework for accelerated simulation, data generation and spatial computing.☆5,892Updated last week
- The NVIDIA® Tools Extension SDK (NVTX) is a C-based Application Programming Interface (API) for annotating events, code ranges, and resou…☆478Updated last week
- cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it☆652Updated last week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆8,564Updated 3 months ago
- Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)☆916Updated last year
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,068Updated last year
- Learn CUDA Programming, published by Packt☆1,216Updated last year
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,429Updated this week
- A PyTorch native platform for training generative AI models☆4,809Updated this week
- Examples demonstrating available options to program multiple GPUs in a single node or a cluster☆836Updated 2 months ago