Strivin0311 / llms-learning
A repository sharing the literatures about large language models
☆53Updated this week
Alternatives and similar repositories for llms-learning:
Users that are interested in llms-learning are comparing it to the libraries listed below
- ☆43Updated 2 weeks ago
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆142Updated 2 weeks ago
- My learning notes/codes for ML SYS.☆372Updated this week
- ☆50Updated 3 months ago
- Multi-Candidate Speculative Decoding☆33Updated 8 months ago
- Curation of resources for LLM research, screened by @tongyx361 to ensure high quality and accompanied with elaborately-written concise de…☆45Updated 6 months ago
- 📰 Must-read papers on KV Cache Compression (constantly updating 🤗).☆260Updated this week
- ☆41Updated last month
- The blog, read report and code example for AGI/LLM related knowledge.☆28Updated last week
- Learning material for CMU10-714: Deep Learning System☆229Updated 8 months ago
- A PyTorch-like deep learning framework. Just for fun.☆141Updated last year
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆38Updated 2 months ago
- Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**☆151Updated 7 months ago
- Implement some method of LLM KV Cache Sparsity☆30Updated 7 months ago
- The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference☆54Updated last month
- Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.☆186Updated last month
- ☆212Updated 8 months ago
- Puzzles for learning Triton, play it with minimal environment configuration!☆205Updated last month
- My solutions to the assignments of CMU 10-714 Deep Learning Systems 2022☆34Updated 9 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆89Updated last month
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆69Updated last month
- ☆76Updated 3 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆69Updated last year
- REST: Retrieval-Based Speculative Decoding, NAACL 2024☆186Updated last month
- ☆36Updated 3 months ago
- Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)☆85Updated 3 months ago
- A collection of 150+ surveys on LLMs☆236Updated 3 months ago
- The course website for Large Language Models Methods and Applications☆28Updated 8 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆145Updated 8 months ago
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆131Updated 6 months ago