PFCCLab / Starter
【HACKATHON 预备营】飞桨启航计划集训营
☆16Updated this week
Alternatives and similar repositories for Starter
Users that are interested in Starter are comparing it to the libraries listed below
Sorting:
- 飞桨护航计划集训营☆18Updated 2 weeks ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆69Updated 3 weeks ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆55Updated 6 months ago
- A light llama-like llm inference framework based on the triton kernel.☆115Updated this week
- 分层解耦的深度学习推理引擎☆72Updated 2 months ago
- PaddlePaddle Developer Community☆108Updated this week
- ☆237Updated 3 months ago
- ☆24Updated last week
- 本项目为飞桨框架学习群的活动☆25Updated last year
- ☆7Updated 7 months ago
- b站上的课程☆74Updated last year
- easy cuda code☆71Updated 4 months ago
- Tutorials for writing high-performance GPU operators in AI frameworks.☆130Updated last year
- 📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.☆171Updated last month
- PFCC 社区博客☆11Updated this week
- some hpc project for learning☆22Updated 8 months ago
- my cs notes☆48Updated 6 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆88Updated 4 months ago
- ☆271Updated 7 months ago
- A minimalist and extensible PyTorch extension for implementing custom backend operators in PyTorch.☆33Updated last year
- Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing☆46Updated 4 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆47Updated last year
- ☆123Updated last year
- A tutorial for CUDA&PyTorch☆138Updated 3 months ago
- Parallel Prefix Sum (Scan) with CUDA☆19Updated 10 months ago
- 训练营讲义☆18Updated 3 months ago
- Implement custom operators in PyTorch with cuda/c++☆60Updated 2 years ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆36Updated last month
- Some common CUDA kernel implementations (Not the fastest).☆18Updated 3 weeks ago
- ☆32Updated last year