LLM Kernel Library for Rust
☆30Jul 20, 2026Updated this week
Alternatives and similar repositories for attention.rs
Users that are interested in attention.rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆293Updated this week
- ☆12Jan 4, 2024Updated 2 years ago
- Testbed for LLM inference with cutile-rs.☆67Jul 1, 2026Updated 2 weeks ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 6 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆700Jul 14, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Fast Tokens☆113Jun 23, 2026Updated 3 weeks ago
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆121Feb 28, 2026Updated 4 months ago
- Token De/Serializer for testing De/Serialize implementations☆14Dec 17, 2024Updated last year
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆86Updated this week
- ☆160Updated this week
- ☆310Jun 9, 2026Updated last month
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆35May 22, 2026Updated last month
- A fast and space-efficient graph storage data structure.☆22May 27, 2026Updated last month
- ☆25Jan 29, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Client libraries of end users of Apache Kyuubi☆11May 15, 2026Updated 2 months ago
- Experimental compiler for deep learning models☆75Sep 18, 2025Updated 10 months ago
- llama2 inference engine in Rust☆13Apr 12, 2024Updated 2 years ago
- Fork of LLVM with support for downgrading bitcode.☆21Jun 9, 2026Updated last month
- ☆19Dec 31, 2025Updated 6 months ago
- Low rank adaptation (LoRA) for Candle.☆176Apr 18, 2025Updated last year
- A Next-Gen AI-native Kernel programming DSL for Maximizing Productivity☆34Updated this week
- Rust based high-performance Apache Uniffle shuffle-server☆70Jul 15, 2026Updated last week
- BLAS for Rust☆16May 12, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆16May 22, 2026Updated last month
- High Performance KV Cache Store for LLM☆59May 20, 2026Updated 2 months ago
- A plugin to enable Apache Spark to read HDF5 files☆20Nov 17, 2016Updated 9 years ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated 11 months ago
- Graph model execution API for Candle☆18Jul 27, 2025Updated 11 months ago
- A tiny library for parsing the Accept-Language header from browsers☆15Aug 19, 2023Updated 2 years ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆32Updated this week
- Measuring Thinking Efficiency in Reasoning Models - Research Repository☆39Dec 2, 2025Updated 7 months ago
- ☆21Jun 17, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 15-721 Spring 2024 - Cache #1☆12May 2, 2024Updated 2 years ago
- Yuca: A light-weight, in-memory, fast and simple to use search engine library.☆13Apr 3, 2019Updated 7 years ago
- Running LLaMA 3 with Rust.☆10May 21, 2024Updated 2 years ago
- ☆13Jan 30, 2023Updated 3 years ago
- Library for building stateful property tests using the proptest crate☆26Oct 7, 2025Updated 9 months ago
- ☆54Updated this week
- A tool for coordinated checkpoint/restore of distributed applications with CRIU☆35May 11, 2026Updated 2 months ago