Optimize softmax in triton in many cases
☆23Sep 6, 2024Updated last year
Alternatives and similar repositories for optimize_softmax
Users that are interested in optimize_softmax are comparing it to the libraries listed below
Sorting:
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆35Sep 15, 2023Updated 2 years ago
- FlagGems is an operator library for large language models implemented in the Triton Language.☆904Updated this week
- ☆32Jul 2, 2025Updated 8 months ago
- ☆21Aug 14, 2024Updated last year
- 一个轻量化的大模型推理框架☆21May 26, 2025Updated 9 months ago
- 使用 cutlass 实现 flash-attention 精简版，具有教学意义☆58Aug 12, 2024Updated last year
- Implementation from scratch in CUDA C++ of image processing algorithms.☆21Oct 26, 2020Updated 5 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆64Nov 8, 2024Updated last year
- ☆30Nov 16, 2024Updated last year
- TensorRT encapsulation, learn, rewrite, practice.☆30Oct 19, 2022Updated 3 years ago
- ☆69Mar 19, 2023Updated 2 years ago
- All Resources from Stanford CS106B 2021☆23Jul 11, 2025Updated 7 months ago
- ☆28Updated this week
- ☆155Mar 4, 2025Updated 11 months ago
- This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.☆43Sep 29, 2025Updated 5 months ago
- C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.☆35Nov 30, 2022Updated 3 years ago
- 大规模并行处理器编程实战 第二版答案☆35Jun 4, 2022Updated 3 years ago
- Penn CIS 5650 (GPU Programming and Architecture) Final Project☆44Dec 11, 2023Updated 2 years ago
- ☆115May 16, 2025Updated 9 months ago
- 跟着Tensorrt_pro学习各种知识☆40Nov 25, 2022Updated 3 years ago
- Cartesian impedance controller for pr2☆10Jul 9, 2015Updated 10 years ago
- a simple API to use CUPTI☆11Aug 19, 2025Updated 6 months ago
- Eagle and EagleSim: Deep-RL for PTZ Cameras☆10Aug 23, 2024Updated last year
- Common template for pytorch project. Easy to extent and modify for new project.☆13Dec 13, 2022Updated 3 years ago
- [ICCV 2025] Repository for A Quality-Guided Mixture of Score-fusion Experts Framework for Human Recognition☆16Sep 29, 2025Updated 5 months ago
- ☆13Dec 9, 2024Updated last year
- A std::execution style runtime context and High Performance RPC Transport for using OpenUCX. Including CUDA/ROCM/... devices with RDMA.☆29Feb 22, 2026Updated last week
- Multi-heap-sort for many small arrays, quicksort with 3 pivots for one big array, CUDA acceleration, CUDA memory compression.☆13Sep 29, 2024Updated last year
- Dataset for the paper "HVAQ: A High-Resolution Vision-Based Air Quality Dataset"☆10Nov 20, 2021Updated 4 years ago
- Collision-detection and collision-avoidance navigation demonstration using a feedforward neural network.☆13Nov 4, 2018Updated 7 years ago
- GEMM☆10Aug 26, 2023Updated 2 years ago
- The codes for ECCV'22: Learning to Train a Point Cloud Reconstruction Network without Matching☆10Nov 16, 2022Updated 3 years ago
- cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容☆12Jul 25, 2022Updated 3 years ago
- Official Pytorch implementation of the AAAI 2025 "Spiking Point Transformer for Point Cloud Classification"☆15Apr 12, 2025Updated 10 months ago
- Inference deployment of the llama3☆11Apr 21, 2024Updated last year
- This repo is used for archiving my notes, codes and materials of cs learning.☆79Feb 16, 2026Updated 2 weeks ago
- ☆47Mar 27, 2023Updated 2 years ago
- Estimating normal map and depth map using Frankot Chellappa algorithm in Python☆13Nov 12, 2022Updated 3 years ago
- ☆24May 9, 2025Updated 9 months ago