☆32Mar 24, 2025Updated last year
Alternatives and similar repositories for FastTree-Artifact
Users that are interested in FastTree-Artifact are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A recommendation model kernel optimizing system☆13Jun 5, 2025Updated last year
- [ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference☆55Jun 17, 2025Updated last year
- An Optimizing Compiler for Recommendation Model Inference☆26Jun 5, 2025Updated last year
- ☆15Jan 7, 2022Updated 4 years ago
- Artifact Evaluation for SOSP 2025☆22Aug 16, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆23Aug 15, 2026Updated 2 weeks ago
- A Parallel Secure Machine Learning Framework on GPUs☆21Nov 17, 2021Updated 4 years ago
- 此项目是我个人对MIT 6.5940 课程作业的答案，学习笔记和心得。☆15Mar 1, 2024Updated 2 years ago
- [ICML 2025] Adaptive Self-improvement LLM Agentic System for ML Library Development☆17Jan 6, 2026Updated 7 months ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆517Aug 24, 2026Updated last week
- GBDT-based model with efficient unlearning (SIGMOD 2023)☆10Sep 7, 2025Updated 11 months ago
- ☆17Nov 11, 2025Updated 9 months ago
- ☆26Apr 13, 2025Updated last year
- Hydragen: High-Throughput LLM Inference with Shared Prefixes☆58May 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆28Oct 11, 2022Updated 3 years ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆119Dec 2, 2025Updated 8 months ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆126Mar 13, 2024Updated 2 years ago
- [VLDB 26, NeurIPS 25] Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.☆151Jul 30, 2026Updated last month
- A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …☆333Jun 10, 2025Updated last year
- ☆33Jul 17, 2024Updated 2 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆246Sep 24, 2023Updated 2 years ago
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆76Mar 11, 2026Updated 5 months ago
- ☆20Dec 24, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆36Jan 27, 2026Updated 7 months ago
- Vortex: Programmable Sparse Attention for Agents as Algorithm Designers☆68Aug 22, 2026Updated last week
- Samoyeds: Accelerating MoE Models with Structured Sparsity Leveraging Sparse Tensor Cores (EuroSys'25)☆16Jul 17, 2025Updated last year
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆109Jul 8, 2026Updated last month
- ☆269Dec 25, 2025Updated 8 months ago
- A throughput-oriented high-performance serving framework for LLMs☆974Mar 29, 2026Updated 5 months ago
- Prefix-Aware Attention for LLM Decoding☆45May 26, 2026Updated 3 months ago
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Jul 17, 2026Updated last month
- ☆107Sep 9, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆13Aug 12, 2026Updated 2 weeks ago
- 一个简单的小网页，录入人声哼唱，转化成钢琴音及钢琴谱输出。灵感稍纵即逝，本项目的目标是能够记录下一段小调，以音频形式输入，读取识别其曲调，并制成谱子，最终以钢琴弹奏的形式输出，依此将一些日常生活中的小灵感保存起来，以便日后回忆甚至再创作。☆97Jan 16, 2021Updated 5 years ago
- Sparse kernels for GNNs based on TVM☆17Nov 18, 2020Updated 5 years ago
- ☆11May 13, 2025Updated last year
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆226Sep 21, 2024Updated last year
- ☆29Mar 12, 2026Updated 5 months ago
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated 2 years ago