IIMunchII / restllm
REST API for Large Language Models using FastAPI, Redis and LiteLLM
☆14Updated last year
Alternatives and similar repositories for restllm
Users that are interested in restllm are comparing it to the libraries listed below
Sorting:
- Reactive DDD with DSPy☆22Updated last year
- An LLM playground similar to the OpenAI API playground☆21Updated last year
- The Indox Ecosystem offers integrated AI tools for data workflows. Our four components (IndoxArcg, IndoxMiner, IndoxJudge, and IndoxGen) …☆20Updated 2 weeks ago
- Build reliable, secure, and production-ready AI apps easily.☆72Updated this week
- ✅ Pytest-style test runner for langchain projects☆25Updated 2 years ago
- Structured outputs from DSPy and Jinja2☆23Updated 4 months ago
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…☆17Updated last week
- Cache requests to OpenAI API and see what requests were made with responses, analytics inspired by Helicone but more simple, currently ai…☆17Updated 2 years ago
- A Model Context Protocol server for Python code analysis with Claude. Again, works with warning now. I'm missing something here.☆13Updated 4 months ago
- RAG with postgreSQL(nebius) and pgvector☆24Updated 5 months ago
- ☆27Updated 10 months ago
- Winning Hackathon entry for Streamlit LLM Hackathon October 2023☆15Updated last year
- ☆17Updated 5 months ago
- ☆38Updated last year
- RAG example using DSPy, Gradio, FastAPI☆79Updated last year
- Writing and Citation Assistant Tool☆25Updated 9 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 6 months ago
- Annoucing Instructor Cloud☆36Updated 9 months ago
- WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…☆29Updated 8 months ago
- ☆20Updated last year
- A Langchain driven project to create flexible LLM bots on Google Cloud Platform☆39Updated last year
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆99Updated 3 weeks ago
- Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.☆64Updated 7 months ago
- ☆69Updated this week
- Agile Agents (A2) is an open-source framework for the creation and deployment of serverless intelligent agents using public and private c…☆20Updated 10 months ago
- LangChain + LiteLLM that works☆41Updated last month
- This tool allows you to search ArXiv for scientific papers, extract their content, embed and chunk the text, and ask questions about them…☆29Updated 10 months ago
- ☆11Updated 8 months ago
- An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate h…☆20Updated 9 months ago
- AI conflict resolution framework designed to work alongside existing AI orchestration tools☆24Updated 5 months ago