How to quickly serve an LLM using Fast API, Celery, and Redis
☆17Aug 29, 2023Updated 3 years ago
Alternatives and similar repositories for FastAPI-LLM-Model-Serving
Users that are interested in FastAPI-LLM-Model-Serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple FastAPI service for LLAMA-2 7B chat model☆21Oct 18, 2023Updated 3 years ago
- A demonstration of using LangServe to create an API from a LCEL Chain!☆15Dec 14, 2023Updated 2 years ago
- Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2☆15Jun 27, 2025Updated last year
- Perform visual question answering on your images☆19May 8, 2024Updated 2 years ago
- My hands-on learning experience with transformers (GPTs)☆10Apr 27, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Accelerating LLM inference with techniques like speculative decoding, quantization, and kernel fusion, focusing on implementing state-of-…☆11Jul 1, 2025Updated last year
- python-to-triton-llm☆10Aug 25, 2025Updated last year
- ☆10Jul 27, 2022Updated 4 years ago
- audio, NLP, ML with huggingface, nvidia/nemo, speechbrain☆11Sep 4, 2023Updated 3 years ago
- Notes and code for Programming Massively Parallel Processors☆13Mar 29, 2025Updated last year
- Authorization is one of the foundational needs when building your applications and services. Learn how, with the help of Cedar and Amazon…☆12Apr 14, 2026Updated 7 months ago
- Hands-on Application Building with GraphQL, Published by Packt☆10Nov 5, 2023Updated 3 years ago
- A simple IDS with statistical learning☆13Jul 5, 2026Updated 4 months ago
- Big Data Inventory Management on AWS (Demand Forecasting, Machine Learning, Dashboarding) : Presented at Carlson School of Management dur…☆11Apr 15, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ML and other modules for OM1☆13Jul 13, 2026Updated 4 months ago
- Refactor your code with local LLM in VSCode☆13Mar 14, 2024Updated 2 years ago
- This repository builds a new Vision-Language-Action (VLA) framework using Apple’s FastVLM as the vision-language backbone, with an Action…☆12Nov 1, 2026Updated 3 weeks ago
- An data analysis project performed on the US video dataset from youtube.☆11Aug 24, 2020Updated 6 years ago
- ☆16Mar 23, 2025Updated last year
- ☆12Jun 29, 2026Updated 4 months ago
- Using RAG to generate data for model fine-tuning.☆15Apr 16, 2025Updated last year
- Simple CogVLM client script☆13Dec 20, 2023Updated 2 years ago
- ☆10Jul 1, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10May 26, 2023Updated 3 years ago
- ☆12Feb 6, 2024Updated 2 years ago
- Node-RED Flow (and web page example) for the LLaMA AI model☆11Jul 27, 2023Updated 3 years ago
- In this project Live Video Streaming is Done with Python Using Flask and Gunicorn as a production WSGI server with gevent for asynchronou…☆12Sep 26, 2020Updated 6 years ago
- Integrating FastVLM as a Remote Source Zoo Model for FiftyOne☆11Nov 24, 2025Updated 11 months ago
- GUI Dataset Collector: A Tool for Capturing and Annotating GUI Interactions with annotations in COCO format☆13Aug 18, 2025Updated last year
- ☆10Apr 12, 2021Updated 5 years ago
- Compute clustering on your data in a visual, intuitive way with FiftyOne and Sklearn!☆12Oct 22, 2024Updated 2 years ago
- HTTP reverse proxy implementation based on Node.js and Docker☆10May 25, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A web-based interactive 3D point cloud segmentation and annotation tool, using the AGILE3D click‑based segmentation algorithm and Gemini …☆11Nov 28, 2025Updated 11 months ago
- This project is a reference implementation of the Hierarchical Navigable Small World graph paper by Malkov & Yashunin (2018) as a compani…☆18Sep 13, 2023Updated 3 years ago
- CRUD with Authentication and Authorization using Get x cli pattern and Supabase☆11Nov 5, 2023Updated 3 years ago
- AZ-204 Developing Solutions for Microsoft Azure, by Packt Publishing☆13Nov 13, 2023Updated 3 years ago
- Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs…☆10Dec 2, 2024Updated last year
- Sample architecture to process events asynchronously using API Gateway and Lambda.☆11Jul 18, 2024Updated 2 years ago
- stateless face recognition as a service☆16Updated this week
Are these results useful?