phospho-app / fastassert
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert:
Users that are interested in fastassert are comparing it to the libraries listed below
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆75Updated 3 weeks ago
- Data Questionnaire Agent Chatbot☆64Updated last week
- Mine-tuning is a methodology for synchronizing human and AI attention.☆17Updated 8 months ago
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- Code interpreter support for o1☆32Updated 5 months ago
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated 7 months ago
- AI real estate agent☆34Updated last year
- A couple scripts to grab stats from email☆42Updated 5 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated 10 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- Verbosity control for AI agents☆60Updated 9 months ago
- Graphlit Platform☆12Updated last year
- Sample applications built on the Graphlit Platform☆69Updated last week
- ☆44Updated 8 months ago
- Web scraping API for building AI applications.☆41Updated last year
- converts url content into JSON with a simple prefix☆66Updated 9 months ago
- ☆53Updated 4 months ago
- Bridge ChatGPT with your system☆27Updated 8 months ago
- Build your Swarm of Internet Agents using MultiOn 🚀☆77Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆63Updated 4 months ago
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆46Updated this week
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆59Updated 7 months ago
- Structured outputs from DSPy and Jinja2☆23Updated 2 months ago
- Create a QnA bot on a pdf☆16Updated last year
- Starter app for creating an AI task completion agent with gmail capabilities.☆27Updated 8 months ago
- auto fine tune of models with synthetic data☆74Updated last year
- sample app about authz and AI☆39Updated 2 weeks ago
- GPT based autonomous agent that does online comprehensive research on any given topic☆11Updated 11 months ago
- ☆29Updated 3 months ago