rlite-project / RLiteLinks
A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithms with minimal intrusion.
☆95Updated 4 months ago
Alternatives and similar repositories for RLite
Users that are interested in RLite are comparing it to the libraries listed below
Sorting:
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆282Updated last month
- (best/better) practices of megatron on veRL and tuning guide☆113Updated 3 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆78Updated last year
- 🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…☆110Updated last month
- ☆133Updated 7 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Updated 5 months ago
- Async pipelined version of Verl☆124Updated 8 months ago
- Bridge Megatron-Core to Hugging Face/Reinforcement Learning☆174Updated last week
- HuggingFace conversion and training library for Megatron-based models☆314Updated this week
- ☆126Updated 6 months ago
- APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-tail Generation. A system-level optimization for scalable LLM tra…☆45Updated 2 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆198Updated 3 weeks ago
- Estimate MFU for DeepSeekV3☆26Updated 11 months ago
- ☆212Updated last month
- Toolchain built around the Megatron-LM for Distributed Training☆81Updated 3 weeks ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆330Updated 8 months ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆159Updated 2 months ago
- Nano repo for RL training of LLMs☆70Updated 2 months ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆256Updated 3 weeks ago
- Triton implementation of FlashAttention2 that adds Custom Masks.☆158Updated last year
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆185Updated 4 months ago
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆93Updated 4 months ago
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆39Updated 10 months ago
- ☆101Updated 10 months ago
- ☆108Updated 3 months ago
- ☆115Updated 7 months ago
- [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning☆56Updated 2 months ago
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆49Updated 4 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆144Updated last week
- ☆440Updated 4 months ago