keli-wen / AGI-StudyLinks
The blog, read report and code example for AGI/LLM related knowledge.
☆49Updated 10 months ago
Alternatives and similar repositories for AGI-Study
Users that are interested in AGI-Study are comparing it to the libraries listed below
Sorting:
- ☆149Updated 5 months ago
- 青稞Talk☆175Updated last week
- Efficient Mixture of Experts for LLM Paper List☆149Updated 2 months ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆137Updated last month
- Unveiling Super Experts in Mixture-of-Experts Large Language Models☆32Updated 2 months ago
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆357Updated 5 months ago
- qwen-nsa☆85Updated 2 months ago
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆49Updated 5 months ago
- ☆154Updated 9 months ago
- Multi-Candidate Speculative Decoding☆38Updated last year
- Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️☆39Updated last year
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆17Updated 9 months ago
- Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**☆215Updated 10 months ago
- ☆208Updated last month
- A repository sharing the literatures about large language models☆106Updated 5 months ago
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆92Updated 3 months ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆113Updated 5 months ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆297Updated 6 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆281Updated last month
- Implement some method of LLM KV Cache Sparsity☆41Updated last year
- ☆125Updated 4 months ago
- ATC23 AE☆47Updated 2 years ago
- Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind☆107Updated last year
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆442Updated this week
- ☆293Updated 5 months ago
- The Official Implementation of Ada-KV [NeurIPS 2025]☆118Updated 3 weeks ago
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆307Updated 11 months ago
- Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)☆340Updated 7 months ago
- [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.☆490Updated last year
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs☆177Updated 2 months ago