AI-Maker-Space / FastAPI-LLM-Model-ServingLinks
How to quickly serve an LLM using Fast API, Celery, and Redis
☆16Updated last year
Alternatives and similar repositories for FastAPI-LLM-Model-Serving
Users that are interested in FastAPI-LLM-Model-Serving are comparing it to the libraries listed below
Sorting:
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 2 months ago
- Find the optimal model serving solution for 🤗 Hugging Face models 🚀☆43Updated 3 weeks ago
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆132Updated 9 months ago
- 💻 Decoding ML articles hub: Hands-on articles with code on production-grade ML☆137Updated 5 months ago
- Sample notebooks and prompts for LLM evaluation☆138Updated 2 months ago
- A repository for all ZenML projects that are specific production use-cases.☆269Updated 2 weeks ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- GenAI Experimentation☆57Updated 3 weeks ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆313Updated last month
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated 10 months ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆48Updated last year
- 🚀 Use NVIDIA NIMs with Haystack pipelines☆32Updated 11 months ago
- A collection of all available inference solutions for the LLMs☆91Updated 5 months ago
- A collection of fine-tuning notebooks!☆27Updated last year
- Self-host LLMs with vLLM and BentoML☆140Updated last week
- A collection of hand on notebook for LLMs practitioner☆49Updated 7 months ago
- This repository will contain the presentation and python jupyter notebooks for the DataHack Summit 2024 conference talk, Improving Real-w…☆118Updated 10 months ago
- Notebooks and Code about Generative Ai, LLMs, MLOPS, NLP , CV and Graph databases☆122Updated last week
- A Hands-on Practical Guide to LlamaIndex☆33Updated 9 months ago
- Various installation guides for Large Language Models☆72Updated 3 months ago
- Build Enterprise RAG (Retriver Augmented Generation) Pipelines to tackle various Generative AI use cases with LLM's by simply plugging co…☆113Updated last year
- A template to kick-start your Python project ✨🚀☆52Updated 3 weeks ago
- Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B☆129Updated last year
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆124Updated last week
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated last year
- Mistral + Haystack: build RAG pipelines that rock 🤘☆105Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆113Updated 4 months ago
- ☆20Updated last year
- Sales Conversion Optimization MLOps: Boost revenue with AI-powered insights. Features H2O AutoML, ZenML pipelines, Neptune.ai tracking, d…☆17Updated 4 months ago
- Building your first LLM application with OpenAI, and AI-assisted Development, step-by-step!☆101Updated 2 months ago