liangyuwang / Tiny-MegatronLinks
Tiny-Megatron, a minimalistic re-implementation of the Megatron library
☆16Updated last week
Alternatives and similar repositories for Tiny-Megatron
Users that are interested in Tiny-Megatron are comparing it to the libraries listed below
Sorting:
- analyse problems of AI with Math and Code☆21Updated last month
- A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention☆162Updated this week
- DeepSeek Native Sparse Attention pytorch implementation☆91Updated 3 weeks ago
- ☆42Updated last year
- Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library☆42Updated last week
- Efficient Mixture of Experts for LLM Paper List☆118Updated this week
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆108Updated 4 months ago
- 16-fold memory access reduction with nearly no loss☆104Updated 5 months ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆58Updated 9 months ago
- ☆143Updated last month
- siiRL: Shanghai Innovation Institute RL Framework for Advanced LLMs and Multi-Agent Systems☆176Updated this week
- A sparse attention kernel supporting mix sparse patterns☆281Updated 6 months ago
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆68Updated 2 months ago
- ☆50Updated 3 months ago
- ☆45Updated 2 months ago
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆40Updated 2 months ago
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆136Updated 3 months ago
- ☆99Updated 2 weeks ago
- ☆146Updated 5 months ago
- qwen-nsa☆74Updated 4 months ago
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆222Updated last month
- Triton Documentation in Chinese Simplified / Triton 中文文档☆80Updated 4 months ago
- Implement some method of LLM KV Cache Sparsity☆35Updated last year
- ☆78Updated 4 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆43Updated last month
- ATC23 AE☆46Updated 2 years ago
- ☆38Updated 3 weeks ago
- Quantized Attention on GPU☆44Updated 9 months ago
- ☆123Updated 3 months ago