Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.
☆107Jul 19, 2023Updated 3 years ago
Alternatives and similar repositories for llm-api-starterkit
Users that are interested in llm-api-starterkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Finetune Your Local LLM☆18Sep 23, 2023Updated 3 years ago
- Train Large Language Models (LLM) using LoRA☆26May 22, 2023Updated 3 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- Beginner-friendly serverless LLM deployment with Replicate & fly.io☆13Sep 3, 2023Updated 3 years ago
- A LLM based virtual game master, supports local LLMs and APIs☆16Feb 3, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Your AI Powered Toolkit☆17May 19, 2024Updated 2 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆143Oct 17, 2023Updated 2 years ago
- The training code to finetune flan-T5 model with text to SQL task☆24Aug 21, 2023Updated 3 years ago
- Blog Post | How to build a CRUD API using Python Flask and SQLAlchemy ORM with PostgreSQL☆19Feb 28, 2023Updated 3 years ago
- REST API for Large Language Models using FastAPI, Redis and LiteLLM☆14Nov 30, 2023Updated 2 years ago
- API gateway and reverse proxy for OpenAI APIs☆15Jul 27, 2023Updated 3 years ago
- Daily TV News Summary using GPT☆24May 16, 2025Updated last year
- ⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops☆938Jul 15, 2024Updated 2 years ago
- OpenAI proxy cloudflare worker☆19Apr 5, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Welcome to LLM-Utility-Cookbook! Here you'll find tools to make LLMs easy: voice to text, text to voice, document scan to text, prompt ma…☆17Jun 12, 2023Updated 3 years ago
- ☆24Jan 11, 2024Updated 2 years ago
- Chat with your data while uploading a pdf file and using a local LLM.☆11Mar 19, 2024Updated 2 years ago
- Like system requirements lab but for LLMs☆31Jun 10, 2023Updated 3 years ago
- 🫧 A one-stop hub, like a sample library 🪂 Azure OpenAI 100+ Sample Code 🧪 Organized by topic for quick reference.☆16Jan 16, 2026Updated 8 months ago
- A Jupyter python notebook to Execute Zapier Tasks with GPT completion via Langchain☆73Jun 2, 2023Updated 3 years ago
- AI models as scalable microservices, enabling evaluation of LLMs and offering end-to-end functions such as chatbot, semantic search, imag…☆29Jul 13, 2026Updated 2 months ago
- Python tool to turn SQL Database Schemas into ChatGPT Prompts☆15Jan 28, 2026Updated 7 months ago
- Link to the dashboard☆13Apr 21, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A working Speech to Speech AI assistant that can interact with you, manage your system, and more!☆15May 1, 2024Updated 2 years ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 2 years ago
- Starter template AI chatbot, built with Next.js and Humanloop☆31Sep 2, 2024Updated 2 years ago
- Plugin for oobabooga/text-generation-webui - Kobold-like API with translation functions☆11May 9, 2023Updated 3 years ago
- Client-side toolkit for using large language models, including where self-hosted☆116Jun 24, 2026Updated 3 months ago
- VMware VM Deployment with NSX/VM Tag Integration, Full Application Deployment and Email Reporting☆13Mar 9, 2020Updated 6 years ago
- Waffer-thin FlaskGPT on Vercel.☆12Jun 1, 2023Updated 3 years ago
- A Flask application for analyzing activity on an online discussion forum, using scraping, indexing, analytics, relational graph and NLP.☆11Nov 24, 2020Updated 5 years ago
- GisPy: A Tool for Measuring Gist Inference Score in Text https://aclanthology.org/2022.wnu-1.5/☆13Jul 1, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The Yahoo Finance Agent is an application that combines OpenAI's LLMs, the Yahoo Finance Python library, and LangChain's tools to provide…☆29Aug 10, 2024Updated 2 years ago
- Machine Learning pipeline MVP on Docker and Apache Airflow☆15Dec 17, 2021Updated 4 years ago
- Ein Programm zur umfassenden Führung eines Dienstplanes für Apotheken.☆13Sep 18, 2026Updated last week
- ☆37Sep 7, 2022Updated 4 years ago
- Skyrails Server integration☆15Aug 15, 2013Updated 13 years ago
- This is a crawler that can scrap Facebook public posts, comments and also scrap the mentions & reactions.☆10Dec 7, 2022Updated 3 years ago
- Create a blockchain in pure python and basic cryptographic primitives.☆10Apr 12, 2021Updated 5 years ago