phospho-app / fastassert
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert:
Users that are interested in fastassert are comparing it to the libraries listed below
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated 2 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆80Updated last year
- Code interpreter support for o1☆32Updated 7 months ago
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated 9 months ago
- Annoucing Instructor Cloud☆36Updated 8 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆77Updated last month
- Bridge ChatGPT with your system☆27Updated 9 months ago
- auto fine tune of models with synthetic data☆75Updated last year
- Mine-tuning is a methodology for synchronizing human and AI attention.☆17Updated 10 months ago
- Extract valuable information from your project github Stars & Forks such as email, company, twitter and then explore it with streamlit🌟☆21Updated last year
- Web scraping API for building AI applications.☆41Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Turns an Airtable base into a WebGL knowledge graph leveraging relational columns☆33Updated 11 months ago
- AI real estate agent☆34Updated last year
- A comprehensive tool for assessing AI Agents performance in simulated poker environments☆19Updated 4 months ago
- Policy Synth is a TypeScript class library designed to streamline and enhance decision-making processes through multi-scale AI agent logi…☆49Updated last week
- Build your Swarm of Internet Agents using MultiOn 🚀☆78Updated last year
- ☆45Updated 10 months ago
- sample app about authz and AI☆43Updated 2 weeks ago
- Graphlit Platform☆17Updated last year
- An open source code of the GitHub Copilot Workspace☆11Updated 10 months ago
- Build reliable, secure, and production-ready AI apps easily.☆72Updated this week
- ☆33Updated 3 months ago
- AI-Driven Decentralized Organization (AIDO) using Supabase and LangChain.js. It includes all necessary files, configurations, tests, and…☆19Updated 5 months ago
- ☆53Updated 6 months ago
- converts url content into JSON with a simple prefix☆68Updated 11 months ago
- Zep: Long-Term Memory for AI Assistants (Python Client)☆106Updated last week
- ☆11Updated 8 months ago
- ☆63Updated last week