Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.
☆13Nov 3, 2023Updated 3 years ago
Alternatives and similar repositories for cuda_back2back_hgemm
Users that are interested in cuda_back2back_hgemm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Specialized Parallel Linear Algebra, providing distributed GEMM functionality for specific matrix distributions with optional GPU acceler…☆33Jun 26, 2024Updated 2 years ago
- Experiments evaluating preemption on the NVIDIA Pascal architecture☆17Nov 10, 2016Updated 9 years ago
- qemu, cuda, virtio and kernel driver etc, none of which I understand, I just in awe.☆13May 2, 2023Updated 3 years ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- llama INT4 cuda inference with AWQ☆55Jan 20, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆575Sep 8, 2024Updated 2 years ago
- ☆23Sep 23, 2026Updated last month
- 6502 Emulator written in C++☆13Feb 18, 2025Updated last year
- [USENIX ATC'25] GeneralSparse: Bridging the Gap in SpMM for Pruned Large Language Model Inference on GPUs☆14Feb 4, 2026Updated 9 months ago
- Lemon is an LALR(1) parser generator for C or C++.☆17Jun 10, 2014Updated 12 years ago
- [MLSys'23] Exploiting Hardware Utilization and Adaptive Dataflow for Efficient Sparse Convolution in 3D Point Clouds.☆13Jun 22, 2023Updated 3 years ago
- Python client for the etcd API v3, supported python >= 3.7, under active maintenance☆13Aug 4, 2025Updated last year
- A intelligent matrix format designer for SpMV☆10Oct 10, 2023Updated 3 years ago
- Source code of the IPDPS '21 paper: "TileSpMV: A Tiled Algorithm for Sparse Matrix-Vector Multiplication on GPUs" by Yuyao Niu, Zhengyang…☆13Aug 12, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- kubernetes调试检测工具☆13Nov 8, 2018Updated 7 years ago
- blockchain open sources☆11Aug 18, 2017Updated 9 years ago
- Offline renderer using CUDA☆13Jun 8, 2020Updated 6 years ago
- Code of Token tracking widgets☆23Jan 15, 2026Updated 9 months ago
- Parallel SpMV using CSR representation, built in CUDA☆14Jun 27, 2020Updated 6 years ago
- ☆11Nov 13, 2022Updated 3 years ago
- ☆10Apr 24, 2023Updated 3 years ago
- ☆13Nov 25, 2019Updated 6 years ago
- Parallel cuckoo hashing on GPUs with CUDA☆12Sep 27, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆17Aug 9, 2022Updated 4 years ago
- Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.☆46Feb 27, 2025Updated last year
- Music GAN - GANSynth preprocessing, ProGAN and DCGAN architecture☆11Jan 26, 2023Updated 3 years ago
- 🍓 A toy object-oriented programming language written by rust☆17Apr 10, 2024Updated 2 years ago
- Mirror of http://gitlab.hpcrl.cse.ohio-state.edu/chong/ppopp19_ae, refactoring for understanding☆17Oct 20, 2021Updated 5 years ago
- A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores☆62Nov 24, 2023Updated 2 years ago
- Yet another Polyhedra Compiler for DeepLearning☆19Apr 14, 2023Updated 3 years ago
- Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL☆27Aug 5, 2026Updated 3 months ago
- Convert CUDA programs from float data type to half or half2 with SIMDization☆19May 28, 2019Updated 7 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SGLang is a fast serving framework for large language models and vision language models.☆16Updated this week
- JAX + Haiku package for the discrete VAE used for DALL·E.☆11Apr 10, 2021Updated 5 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Sep 10, 2024Updated 2 years ago
- ☆36Mar 30, 2026Updated 7 months ago
- fpga学习路线☆14Mar 2, 2023Updated 3 years ago
- Several common methods of matrix multiplication are implemented on CPU and Nvidia GPU using C++11 and CUDA.☆14Feb 8, 2023Updated 3 years ago
- Linux 驱动开发入门与实战--第2 版☆20Aug 4, 2017Updated 9 years ago