Alternatives and similar repositories for awesome-ml-serving:

Users that are interested in awesome-ml-serving are comparing it to the libraries listed below

• substratusai / vllm-docker
  ☆57Updated 3 weeks ago
• awesome-mlops / awesome-mlops-platforms
  A curated list of awesome open source and commercial MLOps platforms 🚀
  ☆25Updated 3 years ago
• iterative / dataset-registry
  Dataset registry DVC project
  ☆74Updated 11 months ago
• msaroufim / torchprep
  ☆13Updated 2 years ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆105Updated last week
• deep-diver / Continuous-Adaptation-for-Machine-Learning-System-to-Data-Changes
  https://blog.tensorflow.org/2021/12/continuous-adaptation-for-machine.html
  ☆30Updated 3 years ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆109Updated last week
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆23Updated last week
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• bentoml / aws-lambda-deploy
  Fast model deployment on AWS Lambda
  ☆14Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• dstackai / dstack-examples
  A collection of examples demonstrating how to use dstack
  ☆26Updated 10 months ago
• deep-diver / semantic-segmentation-ml-pipeline
  Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
  ☆96Updated last year
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated 2 weeks ago
• aporia-ai / mlops.toys
  🎲 A curated list of MLOps projects, tools and resources
  ☆186Updated last year
• bentoml / BentoCLIP
  building a CLIP application using BentoML
  ☆10Updated last month
• infocusp / llm_seminar_series
  Material for the series of seminars on Large Language Models
  ☆34Updated last year
• visenger / Awesome-ML-Model-Governance
  This repository provides a curated list of references about Machine Learning Model Governance, Ethics, and Responsible AI.
  ☆114Updated last year
• tech4ai / t4ai-signature-detect-server
  This project provides a pipeline for deploying and performing inference with the YOLOv8 object detection model using the Triton Inference…
  ☆12Updated 2 weeks ago
• dm4ml / motion
  Framework for building and maintaining self-updating prompts for LLMs
  ☆61Updated 10 months ago
• the-full-stack / gpu-deployments
  Testing methods for GPU deployment
  ☆20Updated 2 years ago
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• GokuMohandas / testing-ml
  Learn how to create reliable ML systems by testing code, data and models.
  ☆86Updated 2 years ago
• the-full-stack / fsdl-text-recognizer-2022
  Source of the FSDL 2022 labs, which are at https://github.com/full-stack-deep-learning/fsdl-text-recognizer-2022-labs
  ☆80Updated last year
• aws-samples / evaluating-large-language-models-using-llm-as-a-judge
  ☆16Updated 3 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated 4 months ago
• aipengineer / awesome-opensource-ai-engineering
  Explore a curated collection of exceptional open-source libraries for generative AI meticulously reviewed or slated for review by The AI …
  ☆53Updated last year
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆86Updated last month
• anyscale / templates
  ☆17Updated this week
• iterative / example-get-started-experiments
  Get started DVC project
  ☆53Updated 9 months ago