phospho-app / fastassert
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated 3 months ago
- Code interpreter support for o1☆32Updated 8 months ago
- Annoucing Instructor Cloud☆36Updated 9 months ago
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- finance agent + with generative ui☆97Updated last year
- Examples and guides for using the Steel API☆36Updated 2 weeks ago
- A couple scripts to grab stats from email☆42Updated 8 months ago
- Turns an Airtable base into a WebGL knowledge graph leveraging relational columns☆33Updated last year
- ☆69Updated this week
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆78Updated 2 months ago
- LLM-ready data connectors☆78Updated 11 months ago
- ☆53Updated 7 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 10 months ago
- Bridge ChatGPT with your system☆27Updated 10 months ago
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated 10 months ago
- AI real estate agent☆34Updated last year
- Verbosity control for AI agents☆63Updated 11 months ago
- The long-term memory for your Superagents 🥷and LLMs 🤖. Built with GraphRAG, Knowledge graphs and autonomous ai agents☆61Updated 3 months ago
- Starter app for creating an AI task completion agent with gmail capabilities.☆27Updated 10 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year
- sample app about authz and AI☆45Updated last month
- Use dynamic few-shot selection to tweet in a particular style☆29Updated 8 months ago
- auto fine tune of models with synthetic data☆75Updated last year
- ☆45Updated 11 months ago
- Powerful Auto Research powered by LangChain, and Anthropic.☆31Updated 10 months ago
- Anthropic Computer Use with Modal Sandboxes☆34Updated 6 months ago
- converts url content into JSON with a simple prefix☆68Updated last year
- A few examples of how Dendrite's SDK can be used to automate web processes and build AI agents.☆37Updated 6 months ago
- Multi-Agents using Workflows☆48Updated 4 months ago