DeepLink-org / DeepLinkExt
☆12Updated last month
Alternatives and similar repositories for DeepLinkExt:
Users that are interested in DeepLinkExt are comparing it to the libraries listed below
- ☆65Updated 3 months ago
- ☆68Updated 3 months ago
- A benchmark suited especially for deep learning operators☆42Updated 2 years ago
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆51Updated 6 months ago
- FlagGems is an operator library for large language models implemented in Triton Language.☆421Updated this week
- A highly optimized LLM inference acceleration engine for Llama and its variants.☆855Updated this week
- ☆142Updated last month
- ☆127Updated last month
- FlagScale is a large model toolkit based on open-sourced projects.☆223Updated this week
- Development repository for the Triton-Linalg conversion☆173Updated 2 weeks ago
- ☆140Updated 9 months ago
- Disaggregated serving system for Large Language Models (LLMs).☆468Updated 6 months ago
- PyTorch distributed training acceleration framework☆39Updated last week
- ☆314Updated last month
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆629Updated last month
- Puzzles for learning Triton, play it with minimal environment configuration!☆229Updated 2 months ago
- TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.☆90Updated last year
- Fast and easy distributed model training examples.☆11Updated 2 months ago
- ☆98Updated 2 months ago
- how to learn PyTorch and OneFlow☆393Updated 10 months ago
- A low-latency & high-throughput serving engine for LLMs☆312Updated 3 weeks ago
- A fast communication-overlapping library for tensor parallelism on GPUs.☆296Updated 3 months ago
- A self-learning tutorail for CUDA High Performance Programing.☆369Updated 2 months ago
- GLake: optimizing GPU memory management and IO transmission.☆431Updated 2 months ago
- learning how CUDA works☆201Updated 6 months ago
- InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…☆348Updated this week
- FlagPerf is an open-source software platform for benchmarking AI chips.☆323Updated 2 weeks ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆78Updated last month
- A baseline repository of Auto-Parallelism in Training Neural Networks☆142Updated 2 years ago