phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- AI real estate agent☆35Updated 2 years ago
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆154Updated last year
- Open-source RAG evaluation through users' feedback☆215Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated 2 years ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Code interpreter support for o1☆31Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆82Updated 11 months ago
- Your local personalised AI agent☆43Updated last year
- Sample applications built on the Graphlit Platform☆76Updated 3 months ago
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆73Updated 2 years ago
- ☆90Updated 2 years ago
- Natural Language Interfaces Powered by LLMs☆95Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month
- RAG example using DSPy, Gradio, FastAPI☆90Updated last year
- Python client library for Graphlit Platform☆19Updated last week
- ☆61Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆44Updated this week
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- Develop, evaluate and monitor LLM applications at scale☆100Updated last year
- ☆171Updated 2 years ago
- Testing and evaluation framework for voice agents☆162Updated 8 months ago
- Multi-Agents using Workflows☆55Updated last year
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆132Updated last year
- ☆76Updated last year
- Build robust, production grade function calling assistants that work. Declarative and extensible. Built on top of LangChain ⚡️☆76Updated last year
- 😎 Sagentic.ai Agent Framework - Sagentic.ai is a unified platform for building, running and scaling autonomous agents.☆74Updated last month
- Automated knowledge graph creation SDK☆124Updated last year
- Legacy project of an analytics platform for LLM-generated content☆439Updated 6 months ago
- ☆125Updated 11 months ago
- Python client library for improving your LLM app accuracy☆97Updated 11 months ago