Alternatives and similar repositories for nki-autotune

Users that are interested in nki-autotune are comparing it to the libraries listed below

• aws-neuron / nki-samples
  ☆37Updated 3 weeks ago
• aws-neuron / nki-reasoning
  Project showing how to develop NKI kernels for Llama 3.2 1B inference
  ☆14Updated 3 weeks ago
• aws-neuron / neuronx-distributed
  ☆58Updated last month
• aws-neuron / neuronx-distributed-inference
  ☆17Updated last month
• aws-neuron / neuronx-nemo-megatron
  ☆38Updated 6 months ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated 2 weeks ago
• aws-neuron / neuronx-distributed-training
  ☆11Updated last month
• aws-samples / sagemaker-bencher
  ☆14Updated 7 months ago
• aws-samples / sagemaker-studio-docker-cli-extension
  SageMaker Studio Docker CLI Extension
  ☆13Updated last year
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆24Updated last year
• awslabs / fmbench-orchestrator
  Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously
  ☆15Updated 2 months ago
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆18Updated this week
• aws-samples / awsome-inference
  ☆47Updated last month
• aws-samples / AI21-on-AWS
  ☆12Updated 8 months ago
• aws-samples / ml-specialized-hardware
  ☆41Updated last month
• aws-samples / Cohere-on-AWS
  ☆27Updated 2 months ago
• aws-samples / awsome-distributed-training
  Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
  ☆313Updated this week
• aws / sagemaker-hyperpod-recipes
  ☆53Updated 3 weeks ago
• aws-samples / deepseek-on-AWS
  ☆10Updated 4 months ago
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆43Updated last year
• awslabs / llmeter
  ☆23Updated 3 months ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆246Updated 2 months ago
• aws-neuron / transformers-neuronx
  ☆110Updated 5 months ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆230Updated this week
• aws-samples / sagemaker-genai-hosting-examples
  ☆105Updated this week
• aws-samples / sagemaker-trainium-examples
  ☆18Updated last year
• aws-samples / fm-leaderboarder
  FM-Leaderboard-er allows you to create leaderboard to find the best LLM/prompt for your own business use case based on your data, task, p…
  ☆18Updated 7 months ago
• aws-neuron / neuron-workshops
  Notebooks and sample code for Build On Trainium
  ☆16Updated last week
• awslabs / amazon-accessible-rl-sdk
  A2RL is a Python library for offline reinforcement learning
  ☆36Updated 9 months ago
• aws-samples / aws-parallelcluster-megatron
  ☆14Updated 4 years ago