awslabs / nki-autotuneLinks
☆15Updated this week
Alternatives and similar repositories for nki-autotune
Users that are interested in nki-autotune are comparing it to the libraries listed below
Sorting:
- ☆58Updated last week
- ☆63Updated 3 weeks ago
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆20Updated 7 months ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆571Updated this week
- Example code for AWS Neuron SDK developers building inference and training applications☆154Updated 3 weeks ago
- ☆26Updated this week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆382Updated this week
- ☆39Updated last year
- ☆111Updated 11 months ago
- ☆14Updated 2 years ago
- Training and inference on AWS Trainium and Inferentia chips.☆254Updated this week
- ☆14Updated 3 weeks ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆34Updated this week
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆247Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆748Updated this week
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated 2 years ago
- Some crazy experiments☆35Updated 4 months ago
- ☆57Updated this week
- ☆551Updated last year
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 9 months ago
- ☆23Updated last month
- ☆14Updated last year
- A schedule language for large model training☆152Updated 4 months ago
- ☆187Updated last year
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆542Updated 3 weeks ago
- ☆15Updated 4 years ago
- Backward compatible ML compute opset inspired by HLO/MHLO☆589Updated 3 weeks ago
- ☆131Updated this week
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Updated 9 months ago
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆258Updated 6 months ago