[Accepted to SOSP 2026] Fast Deterministic LLM Inference
☆21Jul 14, 2026Updated this week
Alternatives and similar repositories for llm-42
Users that are interested in llm-42 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the implementation of our research system Illuminator that was published in ASPLOS 2018 with the title "Making Huge Pages Actuall…☆11Sep 11, 2020Updated 5 years ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆35May 22, 2026Updated last month
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated 2 years ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated 10 months ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An Attention Superoptimizer☆22Jan 20, 2025Updated last year
- ☆139Apr 23, 2026Updated 2 months ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆102Jun 5, 2026Updated last month
- Paper list of federated learning: About system design☆13Apr 13, 2022Updated 4 years ago
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆28Jul 2, 2026Updated last week
- ☆43Sep 6, 2021Updated 4 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- High-performance Rust benchmark client for vLLM serving endpoints.☆43Updated this week
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆16Dec 31, 2025Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆47May 13, 2025Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆16Aug 20, 2024Updated last year
- ☆55Apr 30, 2025Updated last year
- ☆49Dec 19, 2025Updated 6 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆106Apr 7, 2026Updated 3 months ago
- APEX+ is an LLM Serving Simulator☆49Jun 16, 2025Updated last year
- ☆23Jun 1, 2025Updated last year
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Reading seminar in Harvard Cloud Networking and Systems Group☆16Aug 29, 2022Updated 3 years ago
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆19Nov 18, 2024Updated last year
- SQLite bindings for Lean☆48Updated this week
- Code for the paper: Proving Theorems Recursively☆12May 23, 2024Updated 2 years ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆193Feb 11, 2026Updated 5 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆52Jul 4, 2025Updated last year
- Mu: Microsecond Consensus for Microsecond Applications☆43Oct 12, 2020Updated 5 years ago
- ☆17May 10, 2024Updated 2 years ago
- Foundry materializes CUDA graphs along with its execution context to disk to support fast cold start of serving engines.☆45Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Venus Collective Communication Library, supported by SII and Infrawaves.☆149Jun 24, 2026Updated 2 weeks ago
- ☆11Oct 21, 2023Updated 2 years ago
- USTC计算物理A☆10Aug 16, 2021Updated 4 years ago
- JAX bindings for the flash-attention3 kernels☆23Jan 2, 2026Updated 6 months ago
- Prefix-Aware Attention for LLM Decoding☆41May 26, 2026Updated last month
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆32Jun 14, 2024Updated 2 years ago
- Personal knowledge library☆10Nov 9, 2017Updated 8 years ago