MoonshotAI / MoBA
MoBA: Mixture of Block Attention for Long-Context LLMs
☆1,687Updated 2 weeks ago
Alternatives and similar repositories for MoBA:
Users that are interested in MoBA are comparing it to the libraries listed below
- Muon is Scalable for LLM Training☆974Updated 3 weeks ago
- Official Repo for Open-Reasoner-Zero☆1,667Updated 3 weeks ago
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆1,389Updated this week
- An Open Large Reasoning Model for Real-World Solutions☆1,475Updated 3 weeks ago
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆1,210Updated this week
- Scalable RL solution for advanced reasoning of language models☆1,419Updated last week
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆590Updated last week
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆767Updated last week
- Democratizing Reinforcement Learning for LLMs☆2,113Updated last month
- Large Reasoning Models☆799Updated 3 months ago
- Awesome Reasoning LLM Tutorial/Survey/Guide☆1,164Updated last week
- O1 Replication Journey☆1,977Updated 2 months ago
- The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention☆2,415Updated last week
- OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models☆1,732Updated 2 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆1,681Updated this week
- This is a replicate of DeepSeek-R1-Zero and DeepSeek-R1 training on small models with limited data☆3,223Updated this week
- ☆1,348Updated 4 months ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆5,693Updated this week
- [NeurIPS'24 Spotlight, ICLR'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which r…☆945Updated last month
- Witness the aha moment of VLM with less than $3.☆3,376Updated 3 weeks ago
- Fully open data curation for reasoning models☆1,576Updated last week
- A fork to add multimodal model training to open-r1☆1,108Updated last month
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆2,915Updated this week
- OLMoE: Open Mixture-of-Experts Language Models☆693Updated last week
- LIMO: Less is More for Reasoning☆864Updated last month
- Reproduce R1 Zero on Logic Puzzle☆2,208Updated last week
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models☆1,599Updated last year
- FlashInfer: Kernel Library for LLM Serving☆2,483Updated this week
- ☆910Updated 2 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆998Updated 2 months ago