HFAiLab / pytorch_distributedLinks
The test of different distributed-training methods on High-Flyer AIHPC
☆24Updated 2 years ago
Alternatives and similar repositories for pytorch_distributed
Users that are interested in pytorch_distributed are comparing it to the libraries listed below
Sorting:
- Official code for "Binary embedding based retrieval at Tencent"☆43Updated last year
- SuperDebug,debug如此简单!☆17Updated 3 years ago
- differentiable top-k operator☆21Updated 6 months ago
- ☆75Updated 2 months ago
- An object detection codebase based on MegEngine.☆28Updated 2 years ago
- Datasets, Transforms and Models specific to Computer Vision☆87Updated last year
- WanJuan-CC是以CommonCrawl为基础,经过数据抽取,规则清洗,去重,安全过滤,质量清洗等步骤得到的高质量数据。☆13Updated last year
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆17Updated last year
- ☆11Updated last year
- ☆31Updated last year
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated last year
- Dynamic Context Selection for Efficient Long-Context LLMs☆35Updated 2 months ago
- Paddle Automatically Diff Precision Toolkits.☆49Updated last year
- PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References☆17Updated last year
- SGEMM optimization with cuda step by step☆20Updated last year
- OneFlow Serving☆20Updated 3 months ago
- [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling☆86Updated 2 years ago
- study of cutlass☆21Updated 8 months ago
- ☆10Updated 4 years ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆42Updated 2 weeks ago
- ☆42Updated this week
- ☆18Updated 2 years ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆30Updated 2 years ago
- FireFlyer Record file format, writer and reader for DL training samples.☆227Updated 2 years ago
- A minimalistic header only C++11 Neural Network library based on Eigen::Tensor☆20Updated 7 years ago
- A small framework mimics PyTorch using CuPy or NumPy☆41Updated 3 years ago
- ☆19Updated 2 years ago
- HFAI deep learning models☆149Updated 2 years ago
- pytorch-profiler☆51Updated 2 years ago
- Odysseus: Playground of LLM Sequence Parallelism☆70Updated last year