YconquestY / Needle
Imperative deep learning framework with customized GPU and CPU backend
☆30Updated last year
Alternatives and similar repositories for Needle:
Users that are interested in Needle are comparing it to the libraries listed below
- Learning material for CMU10-714: Deep Learning System☆242Updated 10 months ago
- A PyTorch-like deep learning framework. Just for fun.☆148Updated last year
- ☆75Updated last week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆63Updated last week
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆35Updated 3 weeks ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆153Updated 8 months ago
- High performance Transformer implementation in C++.☆113Updated 2 months ago
- ☆50Updated 2 months ago
- Puzzles for learning Triton, play it with minimal environment configuration!☆267Updated 3 months ago
- ☆160Updated last year
- Implement Flash Attention using Cute.☆74Updated 3 months ago
- Cataloging released Triton kernels.☆212Updated 2 months ago
- Code release for book "Efficient Training in PyTorch"☆53Updated 5 months ago
- ☆40Updated last week
- ☆204Updated 4 months ago
- Codes & examples for "CUDA - From Correctness to Performance"☆89Updated 5 months ago
- 📚FFPA(Split-D): Yet another Faster Flash Prefill Attention with O(1) GPU SRAM complexity for headdim > 256, ~2x↑🎉vs SDPA EA.☆157Updated last week
- Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…☆66Updated 4 years ago
- Personal Notes for Learning HPC & Parallel Computation [Active Adding New Content]☆61Updated 2 years ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆81Updated 2 months ago
- A minimal implementation of vllm.☆37Updated 8 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆180Updated 2 months ago
- flash attention tutorial written in python, triton, cuda, cutlass☆308Updated 2 months ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆238Updated 3 weeks ago
- Code base and slides for ECE408:Applied Parallel Programming On GPU.☆120Updated 3 years ago
- Homework solutions for CMU 10-414/714 – Deep Learning Systems: Algorithms and Implementation☆43Updated 2 years ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆48Updated 4 months ago
- DeeperGEMM: crazy optimized version☆63Updated 2 weeks ago
- ☆142Updated 3 months ago
- DGEMM on KNL, achieve 75% MKL☆16Updated 2 years ago