Alternatives and similar repositories for huggingface-inferentia2-samples

Users that are interested in huggingface-inferentia2-samples are comparing it to the libraries listed below

• aws-samples / amazon-sagemaker-nvidia-ngc-examples
  Examples showing use of NGC containers and models withing Amazon SageMaker
  ☆17Updated 2 years ago
• aws-neuron / aws-neuron-eks-samples
  ☆24Updated 3 weeks ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆28Updated 2 years ago
• aws-samples / aws-inferentia-huggingface-workshop
  CMP314 Optimizing NLP models with Amazon EC2 Inf1 instances in Amazon Sagemaker
  ☆14Updated last year
• aws-samples / fine-tune-qwen2-vl-with-llama-factory
  ☆23Updated last month
• aws-samples / aws-do-kubeflow
  A do-framework project to simplify deployment of Kubeflow on Amazon EKS
  ☆21Updated 4 months ago
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆24Updated last year
• aws-samples / parallelize-ml-inference
  Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
  ☆33Updated 5 years ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆89Updated this week
• Vedant-S / MLOps-Project
  Projects completed under LinuxWorld Informatics Ltd. - MLOps Training.
  ☆12Updated 4 years ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆25Updated 6 months ago
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated 2 weeks ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated last year
• aws-solutions-library-samples / guidance-for-machine-learning-inference-on-aws
  This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …
  ☆44Updated 3 weeks ago
• aws-samples / llm-evaluation-methodology
  ☆44Updated 7 months ago
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• aws-samples / amazon-sagemaker-visual-search
  This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…
  ☆11Updated last year
• aws-samples / best-practices-for-fastapi-on-inferentia
  ☆13Updated last year
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated 2 years ago
• aws-samples / aws-do-ray
  Deploy and scale distributed python applications on Amazon EKS using Ray
  ☆15Updated last week
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• aws-samples / sagemaker-trainium-examples
  ☆18Updated last year
• shashankprasanna / kubeflow-pipelines-sagemaker-examples
  Examples for using Amazon SageMaker components in Kubeflow Pipelines
  ☆22Updated 5 years ago
• aws-samples / awsome-inference
  ☆47Updated last month
• aws-samples / sagemaker-hosting
  ☆44Updated last year
• aws-samples / mlops-at-edge-for-quality-inspection
  ☆21Updated 2 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• philschmid / amazon-sagemaker-gpt-j-sample
  ☆28Updated last year