Alternatives and similar repositories for huggingface-inferentia2-samples:

Users that are interested in huggingface-inferentia2-samples are comparing it to the libraries listed below

• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆80Updated last week
• aws-samples / amazon-sagemaker-nvidia-ngc-examples
  Examples showing use of NGC containers and models withing Amazon SageMaker
  ☆17Updated 2 years ago
• aws-samples / fine-tune-qwen2-vl-with-llama-factory
  ☆11Updated last month
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 7 months ago
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• aws-samples / rag-with-amazon-postgresql-using-pgvector-and-sagemaker
  Question Answering application with Large Language Models (LLMs) and Amazon Postgresql using pgvector
  ☆14Updated last month
• aws-neuron / aws-neuron-eks-samples
  ☆20Updated 2 months ago
• ray-project / llms-in-prod-workshop-2023
  Deploy and Scale LLM-based applications
  ☆26Updated last year
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆27Updated 2 years ago
• philschmid / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆10Updated 5 months ago
• premAI-io / serverless-examples
  🚀 End-to-end examples and analysis of deploying LLMs serverless using Modal, Runpod, and Beam
  ☆27Updated 9 months ago
• neuralwork / instruct-finetune-mistral
  Fine-tune Mistral 7B to generate fashion style suggestions
  ☆33Updated last year
• aws-samples / stable-diffusion-prompt-rag
  ☆19Updated last year
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆12Updated last week
• gnovack / distributed-training-and-deepspeed
  ☆17Updated last year
• shashankprasanna / pytorch-examples
  A repository of PyTorch example
  ☆10Updated last year
• NVIDIA / tao_tensorflow1_backend
  TAO Toolkit deep learning networks with TensorFlow 1.x backend
  ☆13Updated 11 months ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆132Updated this week
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆99Updated 6 months ago
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆16Updated last year
• triton-inference-server / developer_tools
  ☆18Updated last week
• aws-samples / aws-do-kubeflow
  A do-framework project to simplify deployment of Kubeflow on Amazon EKS
  ☆20Updated last week
• yaman / fashion-clip-rs
  A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…
  ☆32Updated 5 months ago
• JINO-ROHIT / fastapi_with_celery_redis
  serving a torch model using Celery, Redis and RabbitMQ to serve users asynchronously
  ☆20Updated 11 months ago
• philschmid / amazon-sagemaker-gpt-j-sample
  ☆28Updated last year
• facebookresearch / PostText
  PostText is a QA system for querying your text data. When appropriate structured views are in place, PostText is good at answering querie…
  ☆31Updated last year
• aws-samples / best-practices-for-fastapi-on-inferentia
  ☆12Updated last year
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• dstackai / dstack-examples
  A collection of examples demonstrating how to use dstack
  ☆26Updated 7 months ago
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆18Updated last month