EachSheep / ShortcutsBench

Related projects: ⓘ

• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆93Updated 8 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆190Updated 6 months ago
• Relaxed-System-Lab / COMP4901Y_Course_HKUST
  Course Material for the UG Course COMP4901Y
  ☆46Updated 4 months ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆70Updated last year
• LiuXiaoxuanPKU / OSD
  ☆29Updated last month
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆89Updated last week
• EricLee8 / BaoYan-Algorithm-Problems
  ☆88Updated 3 years ago
• binhu02 / Collection-of-advice-for-PhD-application
  带中文导读的PhD申请攻略收集
  ☆41Updated last year
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆153Updated this week
• LlamaTouch / LlamaTouch
  [UIST 2024] LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
  ☆42Updated last month
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆202Updated 3 weeks ago
• d-matrix-ai / keyformer-llm
  ☆37Updated 5 months ago
• tiingweii-shii / Awesome-Resource-Efficient-LLM-Papers
  a curated list of high-quality papers on resource-efficient LLMs 🌱
  ☆67Updated 2 months ago
• Jometeorie / KnowledgeSpread
  ☆16Updated 2 months ago
• xumengwei / Edge-AI-Paper-List
  ☆184Updated 8 months ago
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆42Updated last year
• aHuiWang / plot_demo
  论文里可以用到的实验图示例
  ☆186Updated 7 months ago
• shinan6 / chatgpt_cmd
  Simply calling chatgpt APIs and store chat history in csv
  ☆22Updated last year
• CGCL-codes / XGCN_library
  ☆52Updated 7 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆84Updated 2 months ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆26Updated last year
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆127Updated 3 months ago
• Hsu1023 / DuQuant
  Rotation and Permutation for Advanced Outlier Management and Efficient Quantization of LLMs
  ☆24Updated last week
• qipengwang / Melon
  MobiSys#114
  ☆21Updated last year
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆350Updated last week
• llmsystem / llmsystem2024spring
  CMU 11868 Large Language Model Systems Spring 2024
  ☆12Updated 4 months ago
• Relaxed-System-Lab / HexGen
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
  ☆14Updated 4 months ago
• mutonix / pyramidinfer
  ☆25Updated last month
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆25Updated 6 months ago
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆60Updated 3 weeks ago