MoonshotAI / checkpoint-engineLinks
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
☆902Updated this week
Alternatives and similar repositories for checkpoint-engine
Users that are interested in checkpoint-engine are comparing it to the libraries listed below
Sorting:
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆830Updated this week
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆384Updated last week
- Block Diffusion for Ultra-Fast Speculative Decoding☆459Updated this week
- OpenTinker is an RL-as-a-Service infrastructure for foundation models☆625Updated last week
- An early research stage expert-parallel load balancer for MoE models based on linear programming.☆495Updated 2 months ago
- ☆957Updated 3 months ago
- Scalable toolkit for efficient model reinforcement☆1,293Updated this week
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆268Updated 2 months ago
- LLM KV cache compression made easy☆866Updated last week
- PyTorch-native post-training at scale☆613Updated this week
- Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support☆266Updated this week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆263Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆676Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,547Updated this week
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆468Updated 8 months ago
- Materials for learning SGLang☆738Updated last month
- Perplexity GPU Kernels☆554Updated 3 months ago
- Accelerating MoE with IO and Tile-aware Optimizations☆569Updated 2 weeks ago
- dInfer: An Efficient Inference Framework for Diffusion Language Models☆410Updated last month
- Efficient LLM Inference over Long Sequences☆394Updated 7 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆273Updated this week
- Training library for Megatron-based models with bidirectional Hugging Face conversion capability☆419Updated this week
- Async RL Training at Scale☆1,044Updated this week
- Serverless LLM Serving for Everyone.☆646Updated 2 weeks ago
- A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…☆131Updated last month
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆220Updated this week
- [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.☆218Updated 8 months ago
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆765Updated 3 weeks ago
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆524Updated 11 months ago
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆564Updated last week