Alternatives and similar repositories for huggingface-inferentia2-samples:

Users that are interested in huggingface-inferentia2-samples are comparing it to the libraries listed below

• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆17Updated 2 years ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated 10 months ago
• aws-samples / fine-tune-qwen2-vl-with-llama-factory
  ☆12Updated last week
• shashankprasanna / pytorch-examples
  A repository of PyTorch example
  ☆9Updated last year
• shashankprasanna / kubeflow-pipelines-sagemaker-examples
  Examples for using Amazon SageMaker components in Kubeflow Pipelines
  ☆22Updated 4 years ago
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆16Updated 2 months ago
• aws-neuron / aws-neuron-eks-samples
  ☆21Updated 2 months ago
• vakyansh / gemma-experimentation
  Experimentation on google's gemma model
  ☆16Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated last year
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated last year
• aws-samples / amazon-sagemaker-nvidia-ngc-examples
  Examples showing use of NGC containers and models withing Amazon SageMaker
  ☆17Updated 2 years ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆85Updated this week
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆104Updated 8 months ago
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆14Updated last year
• aws-samples / sagemaker-hosting
  ☆44Updated 10 months ago
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated last year
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated 2 weeks ago
• substratusai / vllm-docker
  ☆56Updated this week
• sileod / language-model-recommendation
  Resources accompanying the "Zero-Shot Recommendation as Language Modeling" paper (ECIR2022)
  ☆13Updated last year
• qdrant / quaterion-models
  The collection of bulding blocks building fine-tunable metric learning models
  ☆32Updated 2 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆25Updated this week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆140Updated last month
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 9 months ago
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• triton-inference-server / developer_tools
  ☆18Updated 2 weeks ago
• msaroufim / torchprep
  ☆13Updated 2 years ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆28Updated 2 years ago
• Vedant-S / MLOps-Project
  Projects completed under LinuxWorld Informatics Ltd. - MLOps Training.
  ☆12Updated 4 years ago
• comet-ml / blog-serving-hugging-face-models
  ☆20Updated 3 years ago
• sayakpaul / deploy-hf-tf-vision-models
  This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.
  ☆30Updated 2 years ago