microsoft / FractalTensorLinks
FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of lists of statically-shaped tensors, referred to as a FractalTensor.
☆29Updated 10 months ago
Alternatives and similar repositories for FractalTensor
Users that are interested in FractalTensor are comparing it to the libraries listed below
Sorting:
- ☆19Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆100Updated 4 months ago
- ☆47Updated 6 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 11 months ago
- DeeperGEMM: crazy optimized version☆73Updated 6 months ago
- ☆65Updated 6 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆85Updated last month
- GPTQ inference TVM kernel☆39Updated last year
- Debug print operator for cudagraph debugging☆14Updated last year
- A practical way of learning Swizzle☆32Updated 9 months ago
- Artifacts of EVT ASPLOS'24☆28Updated last year
- ☆12Updated 10 months ago
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19Updated last year
- ☆63Updated 5 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆59Updated 7 months ago
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆82Updated this week
- An experimental communicating attention kernel based on DeepEP.☆34Updated 3 months ago
- Tile-based language built for AI computation across all scales☆78Updated this week
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆26Updated 11 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆31Updated 9 months ago
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆38Updated 7 months ago
- ☆56Updated last week
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆26Updated last year
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated last year
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Updated 2 years ago
- ☆50Updated 5 months ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆140Updated 2 years ago
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆62Updated last week
- DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit☆75Updated last week