MoonshotAI / MoBALinks
MoBA: Mixture of Block Attention for Long-Context LLMs
☆1,781Updated last month
Alternatives and similar repositories for MoBA
Users that are interested in MoBA are comparing it to the libraries listed below
Sorting:
- Muon is Scalable for LLM Training☆1,052Updated 2 months ago
- Official Repo for Open-Reasoner-Zero☆1,939Updated last month
- ☆773Updated last month
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆686Updated 2 months ago
- An Open Large Reasoning Model for Real-World Solutions☆1,494Updated this week
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆1,908Updated this week
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,284Updated 3 weeks ago
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆2,453Updated last week
- Democratizing Reinforcement Learning for LLMs☆3,306Updated 2 weeks ago
- Distributed RL System for LLM Reasoning☆1,284Updated this week
- O1 Replication Journey☆1,990Updated 4 months ago
- Scalable RL solution for advanced reasoning of language models☆1,587Updated 2 months ago
- ☆1,354Updated 6 months ago
- Simple RL training for reasoning☆3,601Updated last month
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,035Updated last week
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆2,515Updated this week
- Understanding R1-Zero-Like Training: A Critical Perspective☆956Updated last week
- Large Reasoning Models☆804Updated 5 months ago
- The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention☆2,715Updated 3 weeks ago
- Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities☆868Updated last month
- Official PyTorch implementation for "Large Language Diffusion Models"☆2,036Updated this week
- Witness the aha moment of VLM with less than $3.☆3,706Updated 2 weeks ago
- Fully open data curation for reasoning models☆1,796Updated last week
- OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models☆1,776Updated 4 months ago
- ☆706Updated this week
- ReCall: Learning to Reason with Tool Call for LLMs via Reinforcement Learning☆888Updated 2 weeks ago
- A very simple GRPO implement for reproducing r1-like LLM thinking.☆1,076Updated last month
- Fast, Flexible and Portable Structured Generation☆980Updated last week
- Next-Token Prediction is All You Need☆2,134Updated 2 months ago
- ZeroSearch: Incentivize the Search Capability of LLMs without Searching☆939Updated 2 weeks ago