inclusionAI / asystem-awexLinks
A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from training to inference in RL workflows
☆80Updated this week
Alternatives and similar repositories for asystem-awex
Users that are interested in asystem-awex are comparing it to the libraries listed below
Sorting:
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆252Updated 4 months ago
- Toolchain built around the Megatron-LM for Distributed Training☆76Updated this week
- [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning☆52Updated 3 weeks ago
- torchcomms: a modern PyTorch communications API☆291Updated this week
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆64Updated last year
- ☆199Updated this week
- ☆320Updated last week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆232Updated this week
- An early research stage MoE load balancer based on inear programming.☆228Updated this week
- ☆67Updated 2 months ago
- 🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…☆99Updated 2 weeks ago
- LLM Serving Performance Evaluation Harness☆80Updated 9 months ago
- KV cache store for distributed LLM inference☆363Updated last week
- ☆48Updated last year
- ☆143Updated last week
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆275Updated 2 weeks ago
- ☆79Updated last month
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆159Updated last week
- Stateful LLM Serving☆88Updated 8 months ago
- DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.☆68Updated 2 weeks ago
- JAX backend for SGL☆175Updated this week
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆300Updated last week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆196Updated last year
- ☆43Updated 6 months ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆154Updated last month
- Training library for Megatron-based models☆209Updated this week
- A simple calculation for LLM MFU.☆50Updated 2 months ago
- The driver for LMCache core to run in vLLM☆58Updated 9 months ago
- Fast and memory-efficient exact attention☆14Updated last week
- 16-fold memory access reduction with nearly no loss☆107Updated 7 months ago