aws-neuron / transformers-neuronx

Related projects ⓘ

Alternatives and complementary repositories for transformers-neuronx

• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆127Updated last month
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆209Updated this week
• aws-neuron / neuronx-distributed
  ☆45Updated 3 weeks ago
• aws-neuron / neuronx-nemo-megatron
  ☆33Updated 2 months ago
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆134Updated last month
• aws-neuron / aws-neuron-sdk
  Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…
  ☆462Updated last week
• aws / sagemaker-huggingface-inference-toolkit
  ☆240Updated last month
• aws-samples / awsome-distributed-training
  Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
  ☆202Updated this week
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆22Updated 7 months ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆106Updated last month
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆223Updated 2 months ago
• cohere-ai / cohere-aws
  ☆58Updated this week
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆123Updated this week
• aws-samples / aws-samples-for-ray
  ☆64Updated 4 months ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆78Updated 3 weeks ago
• aws-samples / awsome-inference
  ☆31Updated this week
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆87Updated last year
• aws-samples / llm-evaluation-methodology
  ☆38Updated 3 weeks ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆196Updated this week
• aws / amazon-s3-plugin-for-pytorch
  ☆168Updated last year
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆41Updated last year
• aws-neuron / aws-neuron-sagemaker-samples
  ☆13Updated 4 months ago
• aws-samples / sagemaker-studio-image-build-cli
  CLI for building Docker images in SageMaker Studio using AWS CodeBuild.
  ☆56Updated 2 years ago
• aws / fmeval
  Foundation Model Evaluations Library
  ☆208Updated this week
• aws-samples / aws-do-eks
  Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…
  ☆49Updated 2 weeks ago
• aws-neuron / nki-samples
  ☆11Updated 3 weeks ago
• aws-samples / sagemaker-trainium-inferentia
  ☆11Updated 11 months ago
• aws-samples / sagemaker-genai-hosting-examples
  ☆46Updated this week
• awslabs / ml-io
  A high performance data access library for machine learning tasks
  ☆74Updated 11 months ago
• aws-samples / amazon-sagemaker-local-mode
  Amazon SageMaker Local Mode Examples
  ☆248Updated 3 months ago