How to quickly serve an LLM using Fast API, Celery, and Redis
☆17Aug 29, 2023Updated 3 years ago
Alternatives and similar repositories for FastAPI-LLM-Model-Serving
Users that are interested in FastAPI-LLM-Model-Serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A demonstration of using LangServe to create an API from a LCEL Chain!☆15Dec 14, 2023Updated 2 years ago
- An experiment to see if chatgpt can improve the output of the stanford alpaca dataset☆12Mar 29, 2023Updated 3 years ago
- Hot-plug devices into a Docker container as they are plugged.☆16Aug 10, 2026Updated last month
- A collection of fine-tuning notebooks!☆32Oct 5, 2023Updated 2 years ago
- ☆14Mar 3, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- WaterCooler is an open source, desktop GUI for interacting with ChatGPT, created with Tauri.☆30Dec 28, 2023Updated 2 years ago
- Refactor your code with local LLM in VSCode☆13Mar 14, 2024Updated 2 years ago
- The official python client library for deeq NLP which is new Korean NLP with DL.☆21Aug 2, 2022Updated 4 years ago
- template repository of CRISP-DM☆14Feb 6, 2023Updated 3 years ago
- Official Webassemly (NodeJS) port of OpenFHE: Work in progress☆18May 23, 2025Updated last year
- CRUD with Authentication and Authorization using Get x cli pattern and Supabase☆11Nov 5, 2023Updated 2 years ago
- ☆13Mar 24, 2024Updated 2 years ago
- a docker container containing opencv with gstreamer integration to receive a openHD stream in python3☆12Nov 1, 2021Updated 4 years ago
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Trino On K8S Via Helm & Metastore Workshop Querying Delta Tables☆11Jan 27, 2025Updated last year
- Simple CogVLM client script☆13Dec 20, 2023Updated 2 years ago
- Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant☆16Jan 9, 2023Updated 3 years ago
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10May 26, 2023Updated 3 years ago
- Make machine learning simpler with Galaxy☆12Jul 16, 2024Updated 2 years ago
- cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容☆12Jul 25, 2022Updated 4 years ago
- HTTP reverse proxy implementation based on Node.js and Docker☆10May 25, 2025Updated last year
- Miscellaneous codes and writings for MLOps☆16Apr 8, 2026Updated 5 months ago
- [ACL2023] Source codes for the paper "Werewolf Among Us: Multimodal Resources for Modeling Persuasion Behaviors in Social Deduction Games…☆16Feb 22, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Streamlit Cookbook, published by Packt☆13Jun 6, 2025Updated last year
- Web application to use VidGear Stabilizer easily☆14Feb 15, 2021Updated 5 years ago
- CLV prediction with pareto-NBD model☆12Jul 1, 2016Updated 10 years ago
- In this project Live Video Streaming is Done with Python Using Flask and Gunicorn as a production WSGI server with gevent for asynchronou…☆12Sep 26, 2020Updated 5 years ago
- This repository contains the results and code for the MLPerf™ Inference v3.0 benchmark.☆19Jul 24, 2025Updated last year
- Machine Learning Preprocessing CLI☆13Jun 17, 2024Updated 2 years ago
- mobileNet SSD 基于caffe的前向检测☆10Nov 30, 2018Updated 7 years ago
- Code Repository for Hands-on Application Building with GraphQL, Published by Packt☆18Jun 18, 2026Updated 3 months ago
- The Facial Landmark Detection☆16Jul 20, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Dec 21, 2022Updated 3 years ago
- 青岛船舶检测☆13Apr 16, 2025Updated last year
- Build and train Pytorch models and connect them to the ML lifecycle using Lightning App templates, without handling DIY infrastructure, c…☆11Sep 17, 2022Updated 4 years ago
- ☆12Jun 14, 2024Updated 2 years ago
- IaC scripts for Microsoft Fabric capacity☆11Jan 17, 2024Updated 2 years ago
- Code to scrape CVPR website for list of accepted papers, find their arXiv links, extract metadata, and download pdfs☆10Jun 12, 2024Updated 2 years ago
- Run SOTA Vision-Language Model Florence-2 on your data!☆15Mar 27, 2025Updated last year