AI-Maker-Space / FastAPI-LLM-Model-ServingLinks
How to quickly serve an LLM using Fast API, Celery, and Redis
☆16Updated 2 years ago
Alternatives and similar repositories for FastAPI-LLM-Model-Serving
Users that are interested in FastAPI-LLM-Model-Serving are comparing it to the libraries listed below
Sorting:
- Fine-tune an LLM to perform batch inference and online serving.☆120Updated 8 months ago
- Find the optimal model serving solution for 🤗 Hugging Face models 🚀☆45Updated 6 months ago
- Self-host LLMs with vLLM and BentoML☆168Updated 2 weeks ago
- A repository for all ZenML projects that are specific production use-cases.☆302Updated 2 months ago
- 💻 Decoding ML articles hub: Hands-on articles with code on production-grade ML☆141Updated 11 months ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆314Updated 6 months ago
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆135Updated last year
- Examples of using Evidently to evaluate, test and monitor ML models.☆48Updated last month
- 🚀 Use NVIDIA NIMs with Haystack pipelines☆32Updated last year
- GenAI Experimentation☆59Updated 5 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- Multimodal AI workloads: batch inference, model training and online serving.☆106Updated 5 months ago
- ☆56Updated last year
- A collection of all available inference solutions for the LLMs☆94Updated 11 months ago
- Sample notebooks and prompts for LLM evaluation☆159Updated 3 months ago
- Sales Conversion Optimization MLOps: Boost revenue with AI-powered insights. Features H2O AutoML, ZenML pipelines, Neptune.ai tracking, d…☆21Updated 10 months ago
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆22Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆138Updated last year
- This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.☆224Updated 3 years ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆116Updated last year
- This repository will contain the presentation and python jupyter notebooks for the DataHack Summit 2024 conference talk, Improving Real-w…☆121Updated last year
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆117Updated last year
- A collection of fine-tuning notebooks!☆30Updated 2 years ago
- ☆20Updated last year
- A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).☆41Updated last year
- Join 15k builders to the Real-World ML Newsletter ⬇️⬇️⬇️☆47Updated last year
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Updated last year
- Miscellaneous codes and writings for MLOps☆15Updated 3 weeks ago
- Various installation guides for Large Language Models☆77Updated 9 months ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated last month