☆32Mar 24, 2025Updated last year
Alternatives and similar repositories for FastTree-Artifact
Users that are interested in FastTree-Artifact are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference☆57Jun 17, 2025Updated last year
- A recommendation model kernel optimizing system☆14Jun 5, 2025Updated last year
- An Optimizing Compiler for Recommendation Model Inference☆26Jun 5, 2025Updated last year
- ☆23Sep 14, 2026Updated last month
- ☆15Jun 10, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12May 11, 2025Updated last year
- ☆18Sep 27, 2026Updated last month
- ☆63May 16, 2025Updated last year
- ☆12Nov 26, 2024Updated last year
- A Parallel Secure Machine Learning Framework on GPUs☆21Nov 17, 2021Updated 4 years ago
- Artifact Evaluation for SOSP 2025☆23Aug 16, 2025Updated last year
- [ICML 2025] Adaptive Self-improvement LLM Agentic System for ML Library Development☆17Jan 6, 2026Updated 9 months ago
- 此项目是我个人对MIT 6.5940 课程作业的答案，学习笔记和心得。☆15Mar 1, 2024Updated 2 years ago
- GBDT-based model with efficient unlearning (SIGMOD 2023)☆10Sep 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Dynamic Memory Management for Serving LLMs without PagedAttention☆526Aug 24, 2026Updated 2 months ago
- ☆17Nov 11, 2025Updated 11 months ago
- ☆11Updated this week
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆246Sep 24, 2023Updated 3 years ago
- [VLDB 26, NeurIPS 25] Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.☆154Sep 14, 2026Updated last month
- ☆17Jun 4, 2026Updated 4 months ago
- Prefix-Aware Attention for LLM Decoding☆48May 26, 2026Updated 5 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆228Oct 14, 2026Updated 2 weeks ago
- Hydragen: High-Throughput LLM Inference with Shared Prefixes☆61May 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Artifacts for SWARM: Replicating Shared Disaggregated-Memory Data in No Time☆10Sep 25, 2024Updated 2 years ago
- ☆27Apr 13, 2025Updated last year
- ☆32Sep 26, 2025Updated last year
- ☆27Oct 11, 2022Updated 4 years ago
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆37May 6, 2024Updated 2 years ago
- Pythonic interface and JIT compiler for https://gitcode.com/cann/pto-isa☆28Jun 1, 2026Updated 4 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆122Dec 2, 2025Updated 10 months ago
- Disaggregated serving system for Large Language Models (LLMs).☆846Apr 6, 2025Updated last year
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆363Jun 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The repository for the 2024 IEEE Cloud Submission of OS4C☆10Oct 22, 2026Updated last week
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆16Jul 17, 2025Updated last year
- ☆13Aug 12, 2026Updated 2 months ago
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆79Mar 11, 2026Updated 7 months ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆126Mar 13, 2024Updated 2 years ago
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- ☆20Dec 24, 2024Updated last year