RussWong / LLM-engineering
☆12Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for LLM-engineering
- CPU Memory Compiler and Parallel programing☆24Updated 2 weeks ago
- A CUDA tutorial to make people learn CUDA program from 0☆195Updated 4 months ago
- learning how CUDA works☆162Updated 2 months ago
- CUDA 6大并行计算模式 代码与笔记☆58Updated 4 years ago
- ☆32Updated last month
- A tutorial for CUDA&PyTorch☆117Updated 2 weeks ago
- ☆136Updated this week
- Examples of CUDA implementations by Cutlass CuTe☆86Updated this week
- ☆97Updated 7 months ago
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆36Updated 4 months ago
- ☆56Updated this week
- ☆78Updated 8 months ago
- This project is about convolution operator optimization on GPU, include GEMM based (Implicit GEMM) convolution.☆18Updated last month
- b站上的课程☆70Updated last year
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆48Updated 2 months ago
- 大规模并行处理器编程实战 第二版答案☆27Updated 2 years ago
- TensorRT encapsulation, learn, rewrite, practice.☆24Updated 2 years ago
- ☆103Updated 7 months ago
- llama 2 Inference☆37Updated last year
- A simple neural network inference framework☆23Updated last year
- 分层解耦的深度学习推理引擎☆60Updated 2 months ago
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆26Updated last year
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆22Updated 2 months ago
- Codes & examples for "CUDA - From Correctness to Performance"☆68Updated 2 weeks ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆52Updated 3 months ago
- ☆22Updated 6 months ago
- ☆109Updated 2 years ago
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆39Updated last year
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆105Updated 2 years ago
- TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.☆148Updated this week