MobileLLM / ChainStream

Related projects ⓘ

Alternatives and complementary repositories for ChainStream

• LlamaTouch / LlamaTouch
  LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
  ☆46Updated 3 months ago
• MobileLLM / Personal_LLM_Agents_Survey
  Paper list for Personal LLM Agents
  ☆331Updated 6 months ago
• MobileLLM / AutoDroid
  Source code for the paper "Empowering LLM to use Smartphone for Intelligent Task Automation"
  ☆263Updated 7 months ago
• THUDM / Android-Lab
  ☆128Updated last week
• open-compass / DevBench
  A Comprehensive Benchmark for Software Development.
  ☆84Updated 5 months ago
• UbiquitousLearning / Efficient_Foundation_Model_Survey
  Survey Paper List - Efficient LLM and Foundation Models
  ☆217Updated last month
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆65Updated this week
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆111Updated last month
• AndroidArenaAgent / AndroidArena
  ☆24Updated 7 months ago
• Zefan-Cai / Awesome-LLM-KV-Cache
  Awesome-LLM-KV-Cache: A curated list of 📙Awesome LLM KV Cache Papers with Codes.
  ☆96Updated this week
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆74Updated last year
• metame-ai / awesome-llm-plaza
  awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.
  ☆153Updated this week
• microsoft / vidur
  A large-scale simulation framework for LLM inference
  ☆271Updated last month
• zjunlp / AutoAct
  [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆177Updated last month
• dilab-zju / self-speculative-decoding
  Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
  ☆135Updated 5 months ago
• openpsi-project / ReaLHF
  Super-Efficient RLHF Training of LLMs with Parameter Reallocation
  ☆116Updated last month
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆112Updated last month
• EachSheep / ShortcutsBench
  ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents
  ☆74Updated last month
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆94Updated 9 months ago
• Gentopia-AI / GentPool
  Gentopia Agent Zoo and Agent Benchmark
  ☆28Updated last year
• October2001 / Awesome-KV-Cache-Compression
  📰 Must-read papers on KV Cache Compression (constantly updating 🤗).
  ☆123Updated this week
• algopapi / RetroformAgent
  Langchain Agent finetuning using 7B - LLAMA 2 , on hotpotQA (Retroformer framework)
  ☆14Updated last year
• Infini-AI-Lab / TriForce
  [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
  ☆228Updated 2 months ago
• hemingkx / Spec-Bench
  Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
  ☆183Updated 2 weeks ago
• UChi-JCL / CacheGen
  ☆63Updated last month
• hemingkx / SpeculativeDecodingPapers
  📰 Must-read papers and blogs on Speculative Decoding ⚡️
  ☆451Updated this week
• zorazrw / awesome-tool-llm
  ☆190Updated 2 months ago
• thunlp / LLMxMapReduce
  ☆103Updated 3 weeks ago
• FMInference / H2O
  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
  ☆388Updated 3 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆76Updated last month