DeepLink-org / deeplink.framework
☆62Updated 2 months ago
Alternatives and similar repositories for deeplink.framework:
Users that are interested in deeplink.framework are comparing it to the libraries listed below
- ☆68Updated 2 months ago
- ☆12Updated last week
- A benchmark suited especially for deep learning operators☆42Updated last year
- FlagGems is an operator library for large language models implemented in Triton Language.☆401Updated this week
- ☆140Updated 8 months ago
- ☆141Updated last week
- ☆57Updated 2 months ago
- A collection of memory efficient attention operators implemented in the Triton language.☆230Updated 7 months ago
- FlagScale is a large model toolkit based on open-sourced projects.☆208Updated last week
- Examples of CUDA implementations by Cutlass CuTe☆128Updated last month
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆216Updated last week
- A fast communication-overlapping library for tensor parallelism on GPUs.☆274Updated 2 months ago
- ☆79Updated 4 months ago
- ☆127Updated 3 weeks ago
- ☆94Updated last month
- A Easy-to-understand TensorOp Matmul Tutorial☆306Updated 4 months ago
- Development repository for the Triton-Linalg conversion☆167Updated 3 weeks ago
- High performance Transformer implementation in C++.☆98Updated this week
- Dynamic Memory Management for Serving LLMs without PagedAttention☆273Updated last month
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆205Updated last month
- Sequence-level 1F1B schedule for LLMs.☆16Updated 3 weeks ago
- GLake: optimizing GPU memory management and IO transmission.☆419Updated last month
- A tutorial for CUDA&PyTorch☆126Updated 2 months ago
- Disaggregated serving system for Large Language Models (LLMs).☆440Updated 5 months ago
- A baseline repository of Auto-Parallelism in Training Neural Networks☆142Updated 2 years ago
- ☆127Updated 3 weeks ago
- flash attention tutorial written in python, triton, cuda, cutlass☆250Updated 2 weeks ago
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆384Updated this week
- ☆105Updated 10 months ago
- Efficient and easy multi-instance LLM serving☆278Updated this week