InfiniTensor / ninetoothedLinks
A domain-specific language (DSL) based on Triton but providing higher-level abstractions.
☆30Updated last month
Alternatives and similar repositories for ninetoothed
Users that are interested in ninetoothed are comparing it to the libraries listed below
Sorting:
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆108Updated 3 months ago
- Tile-based language built for AI computation across all scales☆48Updated this week
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆69Updated 2 months ago
- ☆11Updated 8 months ago
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆95Updated 2 months ago
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆27Updated 9 months ago
- A lightweight design for computation-communication overlap.☆161Updated this week
- DeeperGEMM: crazy optimized version☆70Updated 4 months ago
- ☆19Updated 11 months ago
- Stateful LLM Serving☆81Updated 5 months ago
- ☆63Updated 4 months ago
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆37Updated last week
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆27Updated 8 months ago
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆68Updated this week
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆31Updated 6 months ago
- ☆55Updated 3 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆81Updated this week
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆183Updated 7 months ago
- ☆69Updated last year
- ☆14Updated 6 months ago
- kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.☆75Updated this week
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆38Updated 5 months ago
- A practical way of learning Swizzle☆25Updated 7 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 9 months ago
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19Updated last year
- ☆84Updated 5 months ago
- GPTQ inference TVM kernel☆40Updated last year
- ☆37Updated last month
- ☆98Updated 11 months ago
- TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators☆77Updated 2 months ago