phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆154Updated last year
- Open-source RAG evaluation through users' feedback☆215Updated last year
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated 2 years ago
- AI real estate agent☆35Updated 2 years ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆82Updated 11 months ago
- Automated knowledge graph creation SDK☆124Updated last year
- Build robust, production grade function calling assistants that work. Declarative and extensible. Built on top of LangChain ⚡️☆76Updated last year
- Your local personalised AI agent☆43Updated last year
- ☆171Updated 2 years ago
- Natural Language Interfaces Powered by LLMs☆95Updated last year
- Dynamic Metadata based RAG Framework☆78Updated 2 months ago
- ☆90Updated 2 years ago
- Code interpreter support for o1☆31Updated last year
- ☆125Updated 11 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆73Updated 2 years ago
- GuardRail: Advanced tool for data analysis and AI content generation using OpenAI GPT models. Features sentiment analysis, content classi…☆140Updated 2 years ago
- This project enhances the construction of RAG applications by addressing challenges, improving accessibility, scalability, and managing d…☆147Updated last year
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆235Updated last year
- Sample applications built on the Graphlit Platform☆76Updated 3 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆191Updated last year
- Multi-Agents using Workflows☆55Updated last year
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆54Updated last year
- Testing and evaluation framework for voice agents☆162Updated 8 months ago
- simplifies the process of creating and managing LLM workflows.☆113Updated last year
- Data extraction with LLM on CPU☆112Updated 2 years ago
- Cookbooks and tutorials on Literal AI☆55Updated last year
- Use dynamic few-shot selection to tweet in a particular style☆31Updated last year
- RAG example using DSPy, Gradio, FastAPI☆90Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆90Updated last month