ByteDance-Seed / ByteCheckpoint
ByteCheckpoint: An Unified Checkpointing Library for LFMs
☆197Updated 3 weeks ago
Alternatives and similar repositories for ByteCheckpoint:
Users that are interested in ByteCheckpoint are comparing it to the libraries listed below
- VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework☆297Updated 2 weeks ago
- Distributed Triton for Parallel Systems☆451Updated 2 weeks ago
- Zero Bubble Pipeline Parallelism☆383Updated 2 weeks ago
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆270Updated 5 months ago
- Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training☆209Updated 8 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆154Updated 7 months ago
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆477Updated this week
- Perplexity GPU Kernels☆235Updated 2 weeks ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆184Updated last week
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆281Updated 3 months ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆246Updated last month
- ☆237Updated 11 months ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆115Updated 4 months ago
- A sparse attention kernel supporting mix sparse patterns☆197Updated 2 months ago
- nnScaler: Compiling DNN models for Parallel Training☆107Updated last week
- PyTorch bindings for CUTLASS grouped GEMM.☆120Updated 3 months ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆348Updated last week
- ☆131Updated last month
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆94Updated last week
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆46Updated 5 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆210Updated 4 months ago
- [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving☆304Updated 9 months ago
- ☆82Updated 3 weeks ago
- 📰 Must-read papers on KV Cache Compression (constantly updating 🤗).☆376Updated 2 weeks ago
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆453Updated 2 months ago
- A low-latency & high-throughput serving engine for LLMs☆346Updated last week
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆171Updated this week
- Simple extension on vLLM to help you speed up reasoning model without training.☆146Updated this week
- A resilient distributed training framework☆94Updated last year
- ☆20Updated last week