Alternatives and similar repositories for huggingface-inferentia2-samples

Users that are interested in huggingface-inferentia2-samples are comparing it to the libraries listed below

• aws-samples / amazon-sagemaker-nvidia-ngc-examples
  Examples showing use of NGC containers and models withing Amazon SageMaker
  ☆17Updated 2 years ago
• aws-neuron / aws-neuron-eks-samples
  ☆24Updated this week
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆28Updated 2 years ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆25Updated 6 months ago
• aws-samples / fine-tune-qwen2-vl-with-llama-factory
  ☆21Updated 2 weeks ago
• aws-samples / aws-do-ray
  Deploy and scale distributed python applications on Amazon EKS using Ray
  ☆14Updated 2 weeks ago
• msaroufim / torchprep
  ☆13Updated 2 years ago
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated last year
• aws-samples / fine-tune-embedding-models-on-sagemaker
  This repository contains samples for fine-tuning embedding models using Amazon SageMaker. Embedding models are useful for tasks such as s…
  ☆12Updated 3 months ago
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• comet-ml / blog-serving-hugging-face-models
  ☆20Updated 4 years ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆89Updated last week
• aws-samples / llm-evaluation-methodology
  ☆44Updated 7 months ago
• aws-samples / parallelize-ml-inference
  Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
  ☆33Updated 5 years ago
• aws-samples / amazon-sagemaker-managed-spot-training
  Amazon SageMaker Managed Spot Training Examples
  ☆51Updated 11 months ago
• aws-samples / amazon-sagemaker-visual-search
  This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…
  ☆11Updated last year
• NVIDIA-Merlin / core
  Core Utilities for NVIDIA Merlin
  ☆19Updated 10 months ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 2 years ago
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆18Updated 4 months ago
• aws-samples / aws-do-kubeflow
  A do-framework project to simplify deployment of Kubeflow on Amazon EKS
  ☆21Updated 3 months ago
• philschmid / cdk-samples
  ☆57Updated 3 years ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆146Updated last week
• philschmid / amazon-sagemaker-gpt-j-sample
  ☆28Updated last year
• MuhammadBinUsman03 / Real-Time-3-pipeline-LLM-Financial-Advisor
  3-Pipeline LLMOps Financial advisor. Steaming pipeline deployed on AWS, 24/7 collects, embeds live-data into QdrantDB. Training pipeline …
  ☆23Updated last month
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• Vedant-S / MLOps-Project
  Projects completed under LinuxWorld Informatics Ltd. - MLOps Training.
  ☆12Updated 4 years ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆228Updated this week
• bentoml / aws-lambda-deploy
  Fast model deployment on AWS Lambda
  ☆14Updated last year
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆31Updated 2 years ago