Open ABI and FFI for Machine Learning Systems
☆383Apr 26, 2026Updated this week
Alternatives and similar repositories for tvm-ffi
Users that are interested in tvm-ffi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆38Jul 19, 2025Updated 9 months ago
- A home for the final text of all TVM RFCs.☆109Sep 24, 2024Updated last year
- ☆192Mar 28, 2023Updated 3 years ago
- ☆66Apr 26, 2025Updated last year
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆16Oct 11, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Building the Virtuous Cycle for AI-driven LLM Systems☆226Updated this week
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆52Jul 23, 2024Updated last year
- Distributed Compiler based on Triton for Parallel Systems☆1,414Apr 22, 2026Updated last week
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆214Sep 21, 2024Updated last year
- ☆32Jul 2, 2025Updated 9 months ago
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆714Mar 8, 2026Updated last month
- Tile-based language built for AI computation across all scales☆141Mar 27, 2026Updated last month
- A Quirky Assortment of CuTe Kernels☆948Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆5,632Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆119May 19, 2025Updated 11 months ago
- Low overhead tracing library and trace visualizer for pipelined CUDA kernels☆136Nov 26, 2025Updated 5 months ago
- BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.☆762Aug 6, 2025Updated 8 months ago
- Tile primitives for speedy kernels☆3,326Updated this week
- FlashInfer: Kernel Library for LLM Serving☆5,498Updated this week
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆850Updated this week
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,295Aug 28, 2025Updated 8 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated 9 months ago
- a size profiler for cuda binary☆70Jan 15, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Easy-to-understand TensorOp Matmul Tutorial☆428Mar 5, 2026Updated last month
- LoRAFusion: Efficient LoRA Fine-Tuning for LLMs☆26Apr 8, 2026Updated 3 weeks ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆125Dec 25, 2025Updated 4 months ago
- Perplexity open source garden for inference technology☆400Dec 25, 2025Updated 4 months ago
- FlashTile is a CUDA Tile IR compiler that is compatible with NVIDIA's tileiras, targeting SM70 through SM121 NVIDIA GPUs.☆60Feb 6, 2026Updated 2 months ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆478Updated this week
- ☆13Dec 9, 2024Updated last year
- Github mirror of trition-lang/triton repo.☆161Updated this week
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆184Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Fast, Flexible and Portable Structured Generation☆1,643Updated this week
- ☆362Jan 28, 2026Updated 3 months ago
- Autonomous GPU Kernel Generation & Optimization via Deep Agents☆384Updated this week
- A lightweight design for computation-communication overlap.☆227Jan 20, 2026Updated 3 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆57May 29, 2024Updated last year
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆98Dec 2, 2025Updated 4 months ago
- CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-base…☆948Apr 1, 2026Updated 3 weeks ago