microsoft / FractalTensorLinks
FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of lists of statically-shaped tensors, referred to as a FractalTensor.
☆31Updated last year
Alternatives and similar repositories for FractalTensor
Users that are interested in FractalTensor are comparing it to the libraries listed below
Sorting:
- ☆19Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆104Updated 5 months ago
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated last year
- Artifacts of EVT ASPLOS'24☆28Updated last year
- ☆53Updated 7 months ago
- GPTQ inference TVM kernel☆41Updated last year
- TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.☆19Updated last year
- ASPLOS'24: Optimal Kernel Orchestration for Tensor Programs with Korch☆40Updated 9 months ago
- Efficient Compute-Communication Overlap for Distributed LLM Inference☆66Updated last month
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Updated 2 years ago
- A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.☆27Updated last year
- ☆74Updated 6 months ago
- ☆65Updated 8 months ago
- DeeperGEMM: crazy optimized version☆73Updated 7 months ago
- ☆13Updated 11 months ago
- incubator repo for CUDA-TileIR backend☆42Updated this week
- Multi-Level Triton Runner supporting Python, IR, PTX, and cubin.☆78Updated 2 weeks ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆33Updated 10 months ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated last year
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆141Updated 2 years ago
- ☆40Updated 5 years ago
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Updated 6 years ago
- Canvas: End-to-End Kernel Architecture Search in Neural Networks☆26Updated last year
- Framework to reduce autotune overhead to zero for well known deployments.☆91Updated 3 months ago
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆59Updated 9 months ago
- Debug print operator for cudagraph debugging☆14Updated last year
- ☆67Updated this week
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆147Updated 3 months ago
- study of Ampere' Sparse Matmul☆18Updated 4 years ago
- ☆11Updated 4 years ago