Alternatives and similar repositories for AGI-Study:

Users that are interested in AGI-Study are comparing it to the libraries listed below

• madsys-dev / deepseekv2-profile
  ☆71Updated 5 months ago
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆33Updated 8 months ago
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆151Updated 7 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆192Updated last week
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆54Updated 3 weeks ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆183Updated last month
• SkyworkAI / skywork-o1-prm-inference
  ☆49Updated last month
• smart-lty / ParallelSpeculativeDecoding
  The official code for paper "parallel speculative decoding with adaptive draft length."
  ☆32Updated 4 months ago
• mutonix / pyramidinfer
  ☆35Updated last month
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆92Updated 11 months ago
• II-Bench / II-Bench
  ☆26Updated 2 months ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆230Updated 2 months ago
• pprp / Awesome-LLM-Quantization
  Awesome list for LLM quantization
  ☆156Updated 3 weeks ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆135Updated last week
• ClubieDong / QAQ-KVCacheQuantization
  QAQ: Quality Adaptive Quantization for LLM KV Cache
  ☆44Updated 9 months ago
• mdy666 / mdy_triton
  ☆33Updated this week
• THUDM / LongAlign
  [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs
  ☆237Updated last month
• TreeAI-Lab / Awesome-KV-Cache-Management
  ☆43Updated 2 weeks ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆131Updated 6 months ago
• FasterDecoding / SnapKV
  ☆212Updated 8 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆256Updated this week
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆35Updated 8 months ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆213Updated 2 months ago
• inferflow / inferflow
  Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
  ☆236Updated 10 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆154Updated 7 months ago
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆272Updated this week
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆127Updated 7 months ago
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆30Updated 7 months ago
• hengjiUSTC / learn-llm
  ☆95Updated 2 months ago
• FlagOpen / Infinity-Instruct
  ☆44Updated 7 months ago