phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- AI real estate agent☆35Updated last year
- AI Operating System - Build your own AI using ontologies as the unifying field connecting data, models, workflows, and systems.☆63Updated this week
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆79Updated 7 months ago
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆151Updated last year
- Legacy project of an analytics platform for LLM-generated content☆436Updated 2 months ago
- Web App for generating synthetic data☆48Updated last year
- Natural Language Interfaces Powered by LLMs☆92Updated last year
- Open-source RAG evaluation through users' feedback☆205Updated last year
- GuardRail: Advanced tool for data analysis and AI content generation using OpenAI GPT models. Features sentiment analysis, content classi…☆135Updated last year
- Your local personalised AI agent☆42Updated 10 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆184Updated 10 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆54Updated 11 months ago
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆74Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆87Updated last month
- ☆103Updated 2 years ago
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆234Updated 11 months ago
- Automated knowledge graph creation SDK☆122Updated 10 months ago
- Develop, evaluate and monitor LLM applications at scale☆98Updated 10 months ago
- Testing and evaluation framework for voice agents☆151Updated 4 months ago
- Build robust, production grade function calling assistants that work. Declarative and extensible. Built on top of LangChain ⚡️☆77Updated last year
- ☆171Updated last year
- low-code multi-agent automation framework☆259Updated this week
- The long-term memory for your Superagents 🥷and LLMs 🤖. Built with GraphRAG, Knowledge graphs and autonomous ai agents☆63Updated 8 months ago
- Not Diamond Python SDK☆89Updated this week
- Code interpreter support for o1☆32Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆39Updated 2 weeks ago
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- Python client library for improving your LLM app accuracy☆98Updated 8 months ago
- ⚡️ Perplexity.ai style LLM response streaming☆161Updated last year