gasparian / ml-serving-template
Serving large ml models independently and asynchronously via message queue and kv-storage for communication with other services [EXPERIMENT]
β15Updated 3 years ago
Alternatives and similar repositories for ml-serving-template:
Users that are interested in ml-serving-template are comparing it to the libraries listed below
- π€ Trade any tensors over the networkβ30Updated last year
- Fast model deployment on AWS Lambdaβ14Updated 11 months ago
- Prompt Engineering for Large Language Models - Notebooks, Demos, Exercises, and Projectsβ21Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β34Updated last month
- TorchServe+Streamlit for easily serving your HuggingFace NER modelsβ32Updated 2 years ago
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy modβ¦β15Updated last year
- A curated list of ML awesome frameworks & libraries for text dataβ16Updated last year
- State-of-the-art NLP through transformer models in a modular design and consistent APIs.β45Updated last year
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP modelsβ¦β37Updated 2 years ago
- Dataset registry DVC projectβ74Updated 8 months ago
- A proof of concept library for generating and running machine learning model testsβ13Updated 4 years ago
- In this project I played with mlflow, streamlit and fastapi to create a training and prediction app on digitsβ103Updated 3 years ago
- β31Updated 2 years ago
- Codes, scripts, and notebooks on various aspects of transformer models.β27Updated last year
- β13Updated 2 years ago
- Examples of using Evidently to evaluate, test and monitor ML models.β18Updated last month
- Streamlit demo app to demonstrate the features of transformers interpret with multiple models.β25Updated 3 years ago
- Generate summaries from texts using Streamlit & HuggingFace Pipelineβ17Updated 3 years ago
- β28Updated last year
- LLM application tracing based on OpenTelemetryβ10Updated 2 months ago
- MultiOCR, an interface that connects multiple open-source OCR and various Cloud OCR.β31Updated last year
- App store search example, using Jina as backend and Streamlit as frontendβ21Updated 2 years ago
- The collection of bulding blocks building fine-tunable metric learning modelsβ32Updated 3 weeks ago
- Metaflow flows for analyzing topics and sentiments in Hacker Newsβ21Updated 5 months ago
- Confusion Matrix in Python: plot a pretty confusion matrix (like Matlab) in python using seaborn and matplotlibβ19Updated 3 years ago
- MinHash implementation in Pythonβ11Updated 5 months ago
- β17Updated last year
- spaCy match and replace, maintaining conjugationβ35Updated 2 years ago
- β26Updated 2 years ago
- Drift detection module for machine learning pipelines.β21Updated last year