NVIDIA / cuda-pythonLinks
CUDA Python: Performance meets Productivity
☆3,015Updated this week
Alternatives and similar repositories for cuda-python
Users that are interested in cuda-python are comparing it to the libraries listed below
Sorting:
- PyTorch native quantization and sparsity for training and inference☆2,464Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆3,743Updated this week
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,860Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆5,373Updated this week
- CUDA Core Compute Libraries☆1,998Updated this week
- CUDA Library Samples☆2,154Updated this week
- CUDA Templates and Python DSLs for High-Performance Linear Algebra☆8,705Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆3,633Updated this week
- Tile primitives for speedy kernels☆2,859Updated last week
- FlashInfer: Kernel Library for LLM Serving☆3,982Updated this week
- A PyTorch native platform for training generative AI models☆4,604Updated this week
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,486Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,517Updated last week
- A Python framework for accelerated simulation, data generation and spatial computing.☆5,729Updated this week
- NVIDIA Math Libraries for the Python Ecosystem☆528Updated last month
- CUDA integration for Python, plus shiny features☆1,998Updated 3 weeks ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,064Updated last year
- NumPy and SciPy on Multi-Node Multi-GPU systems☆935Updated last week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,876Updated this week
- NVIDIA curated collection of educational resources related to general purpose GPU programming.☆800Updated this week
- Samples for CUDA Developers which demonstrates features in CUDA Toolkit☆8,335Updated last month
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,161Updated 2 months ago
- Optimized primitives for collective multi-GPU communication☆4,182Updated 2 weeks ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,983Updated last week
- NCCL Tests☆1,313Updated this week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,420Updated this week
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆1,911Updated last week
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,596Updated 5 months ago
- Supercharge Your LLM with the Fastest KV Cache Layer☆5,738Updated this week
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,468Updated this week