awslabs / nki-autotuneLinks
☆17Updated 3 weeks ago
Alternatives and similar repositories for nki-autotune
Users that are interested in nki-autotune are comparing it to the libraries listed below
Sorting:
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆20Updated 8 months ago
- ☆58Updated last week
- ☆64Updated last month
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆573Updated last week
- ☆39Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆156Updated 2 weeks ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆386Updated this week
- ☆189Updated last year
- ☆111Updated last year
- ☆26Updated 2 weeks ago
- ☆14Updated last month
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆255Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆781Updated 2 weeks ago
- ☆14Updated 2 years ago
- A schedule language for large model training☆152Updated 5 months ago
- ☆23Updated 2 months ago
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated 2 years ago
- ☆12Updated 8 months ago
- ☆159Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆219Updated last week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆79Updated last month
- Github mirror of trition-lang/triton repo.☆129Updated this week
- Perplexity GPU Kernels☆554Updated 2 months ago
- Training and inference on AWS Trainium and Inferentia chips.☆258Updated this week
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆203Updated this week
- ☆277Updated this week
- ☆145Updated last year
- A Quirky Assortment of CuTe Kernels☆772Updated last week
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆732Updated this week
- Fast low-bit matmul kernels in Triton☆424Updated this week