phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated last year
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆154Updated last year
- Open-source RAG evaluation through users' feedback☆209Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆81Updated 10 months ago
- Natural Language Interfaces Powered by LLMs☆96Updated last year
- Legacy project of an analytics platform for LLM-generated content☆436Updated 5 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- AI real estate agent☆36Updated last year
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆74Updated last year
- ☆90Updated last year
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆54Updated last year
- Build robust, production grade function calling assistants that work. Declarative and extensible. Built on top of LangChain ⚡️☆76Updated last year
- Automated knowledge graph creation SDK☆122Updated last year
- low-code multi-agent automation framework☆265Updated 2 months ago
- Dynamic Metadata based RAG Framework☆78Updated 2 weeks ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆264Updated last week
- RAG example using DSPy, Gradio, FastAPI☆86Updated last year
- A platform designed to facilitate the development of advanced conversational agents using retrieval augmented generation (RAG).☆34Updated 2 months ago
- Python client library for Graphlit Platform☆16Updated last week
- auto fine tune of models with synthetic data☆77Updated last year
- Develop, evaluate and monitor LLM applications at scale☆98Updated last year
- ☆172Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆89Updated last week
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated 2 years ago
- ☆61Updated last year
- Testing and evaluation framework for voice agents☆160Updated 6 months ago
- Your local personalised AI agent☆42Updated last year
- Python SDK for running evaluations on LLM generated responses☆293Updated 6 months ago
- ☆95Updated 2 years ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆189Updated last year