phospho-app / fastassert
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated 11 months ago
Alternatives and similar repositories for fastassert:
Users that are interested in fastassert are comparing it to the libraries listed below
- Code interpreter support for o1☆32Updated 4 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆79Updated 11 months ago
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- AI real estate agent☆34Updated 11 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated 8 months ago
- Annoucing Instructor Cloud☆34Updated 5 months ago
- ☆44Updated 7 months ago
- ⚡️ Perplexity.ai style LLM response streaming☆145Updated 9 months ago
- ☆46Updated 9 months ago
- Bridge ChatGPT with your system☆27Updated 6 months ago
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆43Updated this week
- converts url content into JSON with a simple prefix☆64Updated 8 months ago
- Routing on Random Forest (RoRF)☆98Updated 3 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆73Updated this week
- LLM-ready data connectors☆69Updated 7 months ago
- auto fine tune of models with synthetic data☆74Updated 11 months ago
- Build your Swarm of Internet Agents using MultiOn 🚀☆76Updated last year
- An awesome & curated list of best LLMOps tools for developers☆24Updated last year
- ☆27Updated 7 months ago
- Use dynamic few-shot selection to tweet in a particular style☆26Updated 4 months ago
- ☆57Updated 8 months ago
- Conduct consumer interviews with synthetic focus groups using LLMs and LangChain☆43Updated last year
- 🤖 Headless IDE for AI agents☆151Updated last month
- The next evolution of Agents☆46Updated this week
- Data Questionnaire Agent Chatbot☆63Updated this week
- Structured outputs from DSPy and Jinja2☆20Updated 3 weeks ago
- Ai power Dev using the rUv approach☆65Updated 2 months ago
- Graphlit Platform☆12Updated 10 months ago
- ☆75Updated 11 months ago
- ☆38Updated this week