Testbed for LLM inference with cutile-rs.
☆111Oct 7, 2026Updated last month
Alternatives and similar repositories for grout
Users that are interested in grout are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for pa…☆1,053Oct 8, 2026Updated last month
- MXFP4-compatible 4-bit floating point types and block formats for Rust.☆12Mar 4, 2026Updated 8 months ago
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- ☆12Jan 4, 2024Updated 2 years ago
- Brain floating point type for Swift☆12Oct 12, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LLM Kernel Library for Rust☆32Oct 30, 2026Updated last week
- ☆12Dec 28, 2023Updated 2 years ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 9 months ago
- Experimental compiler for deep learning models☆75Sep 18, 2025Updated last year
- An Extensible Compiler IR Framework☆533Updated this week
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Mar 12, 2025Updated last year
- NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic R…☆4,024Updated this week
- Safe rust wrapper around CUDA toolkit☆1,242Sep 24, 2026Updated last month
- ML framework featuring compile time checks and accelerated by a JIT compiler.☆10Mar 19, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GPT-2 training in pure Mojo with hand-written CUDA and Metal GPU kernels. llm.c parity in bf16 on NVIDIA, 1.72x faster than PyTorch MPS o…☆31Nov 2, 2026Updated last week
- Tensor library for Zig☆12Nov 17, 2024Updated last year
- The Rust library for video generation models based on Candle (HF)☆30Oct 6, 2026Updated last month
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆353Oct 31, 2026Updated last week
- 8-bit floating point types for Rust☆66Feb 4, 2026Updated 9 months ago
- A rust wrapper for HIP☆13Jun 10, 2025Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆740Oct 18, 2026Updated 3 weeks ago
- a GGUF file parser☆25Aug 31, 2026Updated 2 months ago
- ☆20Oct 5, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Rust compiler backend and runtime that compiles Rust kernels to many NPU/GPU accelerators via MLIR — vendor-agnostic (Ascend, Trainium,…☆20Updated this week
- ☆15Dec 4, 2024Updated last year
- ☆36Mar 30, 2026Updated 7 months ago
- A small rust-based data loader☆39Sep 9, 2026Updated 2 months ago
- Automatically derive Python dunder methods for your Rust code☆25Sep 24, 2026Updated last month
- Helpful kernel tutorials, examples and SKILLs for tile-based GPU programming☆838Updated this week
- ☆16Sep 27, 2026Updated last month
- Inference at the speed of light.☆3,047Updated this week
- Sampling techniques for Candle.☆21Apr 3, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 👷 Build compute kernels☆213Apr 6, 2026Updated 7 months ago
- CLI utility to inspect and explore .safetensors and .gguf files☆66Jun 20, 2026Updated 4 months ago
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆62Feb 6, 2026Updated 9 months ago
- A collection of optimisers for use with candle☆51Jun 29, 2026Updated 4 months ago
- ☆14Nov 27, 2025Updated 11 months ago
- The rustic MLIR bindings in Rust☆560Updated this week
- Utilities for taking taskdumps of Tokio tasks☆15Jun 19, 2026Updated 4 months ago
Are these results useful?