phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated last year
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆154Updated last year
- Open-source RAG evaluation through users' feedback☆214Updated last year
- AI real estate agent☆35Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆82Updated 11 months ago
- GuardRail: Advanced tool for data analysis and AI content generation using OpenAI GPT models. Features sentiment analysis, content classi…☆139Updated 2 years ago
- RAG example using DSPy, Gradio, FastAPI☆90Updated last year
- ☆76Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- low-code multi-agent automation framework☆264Updated 2 months ago
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆74Updated last year
- Build robust, production grade function calling assistants that work. Declarative and extensible. Built on top of LangChain ⚡️☆76Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Your local personalised AI agent☆42Updated last year
- Python client library for improving your LLM app accuracy☆97Updated 11 months ago
- Automated knowledge graph creation SDK☆122Updated last year
- ☆102Updated 2 years ago
- ☆63Updated last week
- Legacy project of an analytics platform for LLM-generated content☆440Updated 6 months ago
- ☆45Updated last year
- ☆125Updated 10 months ago
- simplifies the process of creating and managing LLM workflows.☆113Updated last year
- Mine-tuning is a methodology for synchronizing human and AI attention.☆19Updated last year
- ☆171Updated last year
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- Testing and evaluation framework for voice agents☆162Updated 7 months ago
- Rag Chatbot React And Tyepscript base boilerplate☆32Updated last year
- converts url content into JSON with a simple prefix☆72Updated last year
- Natural Language Interfaces Powered by LLMs☆95Updated last year
- Develop, evaluate and monitor LLM applications at scale☆99Updated last year