weigao266 / Awesome-Efficient-ArchLinks
Speed Always Wins: A Survey on Efficient Architectures for Large Language Models
☆320Updated 2 weeks ago
Alternatives and similar repositories for Awesome-Efficient-Arch
Users that are interested in Awesome-Efficient-Arch are comparing it to the libraries listed below
Sorting:
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆188Updated 2 months ago
- TransMLA: Multi-Head Latent Attention Is All You Need☆353Updated 2 weeks ago
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆443Updated 3 months ago
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"☆436Updated last week
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆139Updated 5 months ago
- The official repo of One RL to See Them All: Visual Triple Unified Reinforcement Learning☆312Updated 3 months ago
- ☆422Updated last month
- MiroMind-M1 is a fully open-source series of reasoning language models built on Qwen-2.5, focused on advancing mathematical reasoning.☆227Updated last month
- ☆198Updated 5 months ago
- Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models☆220Updated this week
- Official codebase for "Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling".☆271Updated 6 months ago
- 青稞Talk☆141Updated this week
- Efficient Mixture of Experts for LLM Paper List☆124Updated this week
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆490Updated 7 months ago
- siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems☆185Updated this week
- ☆67Updated 3 months ago
- Official PyTorch implementation of the paper "dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching" (dLLM-Cache…☆148Updated last week
- 🚀ReVisual-R1 is a 7B open-source multimodal language model that follows a three-stage curriculum—cold-start pre-training, multimodal rei…☆178Updated 2 months ago
- Efficient LLM Inference over Long Sequences☆391Updated 2 months ago
- Tina: Tiny Reasoning Models via LoRA☆281Updated last month
- [arXiv 2025] Efficient Reasoning Models: A Survey☆260Updated this week
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆151Updated 2 weeks ago
- ☆814Updated 3 months ago
- qwen-nsa☆74Updated 5 months ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆250Updated 3 months ago
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆226Updated 2 months ago
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆203Updated last month
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆187Updated 2 weeks ago
- [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models☆177Updated 8 months ago
- ☆80Updated 5 months ago