Ascend / torchair
☆10Updated this week
Alternatives and similar repositories for torchair:
Users that are interested in torchair are comparing it to the libraries listed below
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing. By pro…☆70Updated this week
- GPTQ inference TVM kernel☆39Updated 11 months ago
- ☆19Updated 5 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆90Updated last month
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆62Updated 3 weeks ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆78Updated 4 months ago
- ☆24Updated 3 months ago
- DeepSeek-V3/R1 inference performance simulator☆76Updated this week
- DeeperGEMM: crazy optimized version☆61Updated last week
- play gemm with tvm☆89Updated last year
- A practical way of learning Swizzle☆15Updated last month
- Standalone Flash Attention v2 kernel without libtorch dependency☆106Updated 6 months ago
- TensorRT LLM Benchmark Configuration☆13Updated 8 months ago
- ☆39Updated 9 months ago
- Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS☆20Updated last month
- PyTorch distributed training acceleration framework☆46Updated last month
- ☆11Updated 3 years ago
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆93Updated last year
- ☆88Updated 6 months ago
- ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated 4 months ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆35Updated 2 weeks ago
- ☆45Updated this week
- 方便扩展的Cuda算子理解和优化框架,仅用在学习使用☆13Updated 9 months ago
- A simple calculation for LLM MFU.☆27Updated 3 weeks ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆29Updated this week
- Summary of system papers/frameworks/codes/tools on training or serving large model☆56Updated last year
- An Attention Superoptimizer☆21Updated 2 months ago
- Artifacts of EVT ASPLOS'24☆24Updated last year
- ☆25Updated this week
- ☆26Updated last week