fzyzcjy / torch_memory_saverLinks
Allow torch tensor memory to be released and resumed later
☆80Updated last week
Alternatives and similar repositories for torch_memory_saver
Users that are interested in torch_memory_saver are comparing it to the libraries listed below
Sorting:
- PyTorch bindings for CUTLASS grouped GEMM.☆132Updated 6 months ago
- nnScaler: Compiling DNN models for Parallel Training☆113Updated last week
- Zero Bubble Pipeline Parallelism☆406Updated 2 months ago
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆169Updated this week
- PyTorch bindings for CUTLASS grouped GEMM.☆101Updated last month
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆226Updated last week
- Perplexity GPU Kernels☆405Updated this week
- A Quirky Assortment of CuTe Kernels☆281Updated this week
- ☆90Updated 3 months ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆401Updated last month
- A lightweight design for computation-communication overlap.☆146Updated 3 weeks ago
- ☆145Updated 4 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆184Updated this week
- [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…☆58Updated 11 months ago
- ☆96Updated 10 months ago
- A low-latency & high-throughput serving engine for LLMs☆390Updated last month
- ☆100Updated 6 months ago
- A collection of memory efficient attention operators implemented in the Triton language.☆272Updated last year
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆209Updated last week
- High performance Transformer implementation in C++.☆125Updated 6 months ago
- Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training☆212Updated 10 months ago
- DeeperGEMM: crazy optimized version☆69Updated 2 months ago
- ☆216Updated last year
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆259Updated 4 months ago
- Materials for learning SGLang☆481Updated last week
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆79Updated 7 months ago
- kernels, of the mega variety☆441Updated last month
- Applied AI experiments and examples for PyTorch☆281Updated last month
- ☆60Updated 2 months ago
- ☆106Updated 8 months ago