Alternatives and similar repositories for llms-learning:

Users that are interested in llms-learning are comparing it to the libraries listed below

• ParagonLight / llm-course
  ☆45Updated 2 months ago
• PKUFlyingPig / CMU10-714
  Learning material for CMU10-714: Deep Learning System
  ☆233Updated 9 months ago
• MLSys-Learner-Resources / Awesome-MLSys-Blogger
  The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)
  ☆179Updated last month
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆142Updated last year
• nemoworks / NJUGraduateCourses
  ☆68Updated 2 years ago
• TreeAI-Lab / Awesome-KV-Cache-Management
  This repository serves as a comprehensive survey of LLM development, featuring numerous research papers along with their corresponding co…
  ☆64Updated this week
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆229Updated 2 months ago
• binbin00 / NJU_AdvancedProgramming_SP22
  ☆16Updated 3 years ago
• kcxain / dlsys
  My solutions to the assignments of CMU 10-714 Deep Learning Systems 2022
  ☆35Updated 10 months ago
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆306Updated 2 weeks ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆245Updated 2 months ago
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆160Updated last week
• zcli-charlie / Awesome-KV-Cache
  ☆56Updated 4 months ago
• NJUNLP / MCSD
  Multi-Candidate Speculative Decoding
  ☆34Updated 9 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆39Updated 3 months ago
• FFY0 / AdaKV
  The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  ☆58Updated 3 weeks ago
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆30Updated 8 months ago
• keli-wen / AGI-Study
  The blog, read report and code example for AGI/LLM related knowledge.
  ☆32Updated 2 weeks ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆208Updated 2 months ago
• PKU-DAIR / Starter-Guide
  A comprehensive guide for beginners in the field of data management and artificial intelligence.
  ☆146Updated 3 months ago
• tongyx361 / Awesome-LLM-Research
  Curation of resources for LLM research, screened by @tongyx361 to ensure high quality and accompanied with elaborately-written concise de…
  ☆45Updated 7 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆272Updated 3 weeks ago
• FasterDecoding / REST
  REST: Retrieval-Based Speculative Decoding, NAACL 2024
  ☆193Updated 2 months ago
• courses-at-nju-by-hfwei / discrete-math-lectures
  Lectures on Discrete Mathematics @ software.nju.edu.cn
  ☆23Updated 3 years ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆84Updated 4 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆138Updated 7 months ago
• FasterDecoding / SnapKV
  ☆220Updated 9 months ago
• ASC-Competition / ASC24-LLM-inference-optimization
  The dataset and baseline code for ASC23 LLM inference optimization challenge.
  ☆34Updated last year
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆223Updated 3 months ago