awslabs / nki-autotuneLinks
☆15Updated last week
Alternatives and similar repositories for nki-autotune
Users that are interested in nki-autotune are comparing it to the libraries listed below
Sorting:
- ☆56Updated 3 weeks ago
- ☆63Updated 2 weeks ago
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆19Updated 6 months ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆555Updated 3 weeks ago
- Example code for AWS Neuron SDK developers building inference and training applications☆151Updated 3 weeks ago
- ☆39Updated 11 months ago
- ☆23Updated 2 months ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆377Updated last week
- ☆111Updated 10 months ago
- ☆14Updated last year
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA (+ more DSLs)☆683Updated this week
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated 2 years ago
- ☆12Updated 6 months ago
- ☆13Updated 2 months ago
- A schedule language for large model training☆151Updated 3 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆239Updated this week
- ☆23Updated 2 weeks ago
- Training and inference on AWS Trainium and Inferentia chips.☆250Updated this week
- ☆148Updated 11 months ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆32Updated last week
- Perplexity GPU Kernels☆534Updated 3 weeks ago
- ☆145Updated 10 months ago
- ☆23Updated 3 months ago
- ☆57Updated this week
- Repository for SysML19 Artifacts Evaluation☆54Updated 6 years ago
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆130Updated 3 weeks ago
- This repository contains companion software for the Colfax Research paper "Categorical Foundations for CuTe Layouts".☆81Updated 2 months ago
- ☆10Updated 2 years ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆217Updated last week
- ☆185Updated last year