awslabs / nki-autotuneLinks
☆14Updated this week
Alternatives and similar repositories for nki-autotune
Users that are interested in nki-autotune are comparing it to the libraries listed below
Sorting:
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆16Updated last month
- ☆38Updated this week
- ☆59Updated 2 weeks ago
- ☆14Updated 8 months ago
- ☆48Updated last week
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated last year
- ☆10Updated 5 months ago
- ☆12Updated 8 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated last month
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Updated 3 months ago
- FM-Leaderboard-er allows you to create leaderboard to find the best LLM/prompt for your own business use case based on your data, task, p…☆18Updated 8 months ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆323Updated this week
- ☆16Updated last year
- ☆38Updated 6 months ago
- ☆108Updated this week
- ☆27Updated last week
- ☆41Updated 2 months ago
- ☆111Updated 6 months ago
- ☆9Updated last year
- ☆25Updated 4 months ago
- ☆30Updated 8 months ago
- ☆18Updated 5 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆247Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆18Updated 2 weeks ago
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆233Updated last week
- ☆16Updated 2 months ago
- ☆18Updated 3 weeks ago
- ☆23Updated last year
- ☆13Updated last year
- ☆13Updated last month