MoonshotAI / checkpoint-engineLinks
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
☆871Updated this week
Alternatives and similar repositories for checkpoint-engine
Users that are interested in checkpoint-engine are comparing it to the libraries listed below
Sorting:
- ☆610Updated last week
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆469Updated last month
- ☆941Updated last month
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆354Updated this week
- Scalable toolkit for efficient model reinforcement☆1,141Updated this week
- PyTorch-native post-training at scale☆572Updated this week
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆256Updated 2 weeks ago
- LLM KV cache compression made easy☆729Updated last week
- dInfer: An Efficient Inference Framework for Diffusion Language Models☆361Updated 2 weeks ago
- Async RL Training at Scale☆950Updated this week
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆463Updated 7 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,394Updated this week
- A framework for efficient model inference with omni-modality models☆1,335Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆451Updated 2 weeks ago
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆557Updated last week
- Perplexity GPU Kernels☆542Updated last month
- Efficient LLM Inference over Long Sequences☆394Updated 5 months ago
- ☆1,233Updated last month
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆249Updated 2 weeks ago
- Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support☆209Updated last week
- Materials for learning SGLang☆693Updated last week
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆261Updated this week
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆515Updated 10 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆718Updated this week
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆726Updated 3 weeks ago
- ☆1,087Updated this week
- Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache☆136Updated 4 months ago
- [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.☆215Updated 6 months ago
- QeRL enables RL for 32B LLMs on a single H100 GPU.☆467Updated 3 weeks ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆160Updated last week