aws-neuron / nki-samplesLinks
☆35Updated last week
Alternatives and similar repositories for nki-samples
Users that are interested in nki-samples are comparing it to the libraries listed below
Sorting:
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆14Updated last week
- ☆14Updated this week
- ☆57Updated 2 weeks ago
- ☆35Updated 5 months ago
- extensible collectives library in triton☆87Updated 2 months ago
- ☆24Updated last year
- ☆80Updated 6 months ago
- A schedule language for large model training☆148Updated 11 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆146Updated this week
- ☆27Updated 6 months ago
- ☆62Updated 11 months ago
- ☆28Updated 4 months ago
- Collection of kernels written in Triton language☆125Updated 2 months ago
- ☆99Updated last week
- ☆105Updated 9 months ago
- ☆108Updated 4 months ago
- ☆71Updated 2 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆127Updated this week
- Effective transpose on Hopper GPU☆20Updated last month
- ☆14Updated 4 years ago
- Home for OctoML PyTorch Profiler☆113Updated 2 years ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆60Updated 2 months ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆116Updated 6 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆105Updated this week
- ☆86Updated 5 months ago
- LLM Serving Performance Evaluation Harness☆78Updated 3 months ago
- Boosting 4-bit inference kernels with 2:4 Sparsity☆76Updated 9 months ago
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆374Updated this week
- MLIR-based partitioning system☆86Updated this week
- ☆13Updated 3 weeks ago