MoonshotAI / MoBA
MoBA: Mixture of Block Attention for Long-Context LLMs
☆1,733Updated 2 weeks ago
Alternatives and similar repositories for MoBA:
Users that are interested in MoBA are comparing it to the libraries listed below
- Muon is Scalable for LLM Training☆1,020Updated 3 weeks ago
- Official Repo for Open-Reasoner-Zero☆1,850Updated last week
- An Open Large Reasoning Model for Real-World Solutions☆1,484Updated last month
- Scalable RL solution for advanced reasoning of language models☆1,478Updated last month
- Large Reasoning Models☆802Updated 4 months ago
- ☆662Updated this week
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆1,968Updated this week
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,099Updated last week
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆1,359Updated last week
- Distributed RL System for LLM Reasoning☆1,079Updated last week
- O1 Replication Journey☆1,983Updated 3 months ago
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆621Updated 3 weeks ago
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆685Updated this week
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆1,847Updated last week
- Democratizing Reinforcement Learning for LLMs☆2,976Updated last week
- The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention☆2,514Updated last week
- ☆1,351Updated 4 months ago
- [NeurIPS'24 Spotlight, ICLR'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which r…☆969Updated last week
- Fully open data curation for reasoning models☆1,697Updated last week
- Simple RL training for reasoning☆3,435Updated last week
- OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models☆1,756Updated 3 months ago
- Awesome Reasoning LLM Tutorial/Survey/Guide☆1,318Updated last week
- A fork to add multimodal model training to open-r1☆1,181Updated 2 months ago
- Witness the aha moment of VLM with less than $3.☆3,522Updated last month
- Expert Parallelism Load Balancer☆1,136Updated 3 weeks ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆6,699Updated this week
- Reproduce R1 Zero on Logic Puzzle☆2,287Updated 3 weeks ago
- Analyze computation-communication overlap in V3/R1.☆991Updated 3 weeks ago
- Understanding R1-Zero-Like Training: A Critical Perspective☆845Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆3,037Updated this week