Alternatives and similar repositories for AGI-Study:

Users that are interested in AGI-Study are comparing it to the libraries listed below

• mdy666 / mdy_triton
  ☆102Updated last week
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆62Updated 2 weeks ago
• OpenMOSS / Thus-Spake-Long-Context-LLM
  a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation
  ☆43Updated last week
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆35Updated 10 months ago
• madsys-dev / deepseekv2-profile
  ☆125Updated 3 weeks ago
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆132Updated 3 weeks ago
• step-law / steplaw
  ☆139Updated 2 weeks ago
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆35Updated 11 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆86Updated last week
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆67Updated 2 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆60Updated 4 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆80Updated last month
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆48Updated last month
• OpenSparseLLMs / Linear-MoE
  ☆70Updated 2 weeks ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆47Updated 3 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆151Updated 8 months ago
• microsoft / chunk-attention
  ☆65Updated 3 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆27Updated 3 weeks ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆260Updated 4 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆66Updated 9 months ago
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆30Updated 9 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆40Updated 4 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆217Updated 2 months ago
• TemporaryLoRA / Temp-LoRA
  ☆100Updated 11 months ago
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆176Updated last month
• FasterDecoding / SnapKV
  ☆232Updated 10 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆130Updated 9 months ago
• microsoft / SeerAttention
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆88Updated last week
• LINs-lab / DeFT
  [ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference
  ☆16Updated last week
• mdy666 / qwen-nsa
  qwen-nsa
  ☆42Updated last week