leimao / Nsight-Systems-Docker-ImageLinks
Nsight Systems In Docker
☆20Updated last year
Alternatives and similar repositories for Nsight-Systems-Docker-Image
Users that are interested in Nsight-Systems-Docker-Image are comparing it to the libraries listed below
Sorting:
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- ☆29Updated 4 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆92Updated last week
- Standalone Flash Attention v2 kernel without libtorch dependency☆109Updated 8 months ago
- A Winograd Minimal Filter Implementation in CUDA☆24Updated 3 years ago
- llama INT4 cuda inference with AWQ☆54Updated 4 months ago
- ☆67Updated 7 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆88Updated last week
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆30Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆36Updated 2 months ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆94Updated 6 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆13Updated 4 months ago
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆43Updated last week
- Open Source Projects from Pallas Lab☆20Updated 3 years ago
- study of cutlass☆21Updated 6 months ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆43Updated 2 months ago
- GPTQ inference TVM kernel☆40Updated last year
- Benchmark PyTorch Custom Operators☆14Updated last year
- ☆149Updated 2 years ago
- Benchmark scripts for TVM☆74Updated 3 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆64Updated last year
- This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…☆68Updated this week
- RISCV C and Triton AI-Benchmark☆19Updated 7 months ago
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 6 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆15Updated 3 weeks ago
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆79Updated 3 weeks ago
- ☆49Updated 2 weeks ago
- End to End steps for adding custom ops in PyTorch.☆23Updated 4 years ago
- ☆69Updated 2 years ago
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆13Updated 7 months ago