phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year
- Code interpreter support for o1☆32Updated 8 months ago
- AI real estate agent☆34Updated last year
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated 10 months ago
- Mine-tuning is a methodology for synchronizing human and AI attention.☆19Updated 11 months ago
- ☆45Updated 11 months ago
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- ☆53Updated 7 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- ☆1Updated 10 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 10 months ago
- Annoucing Instructor Cloud☆36Updated 9 months ago
- auto fine tune of models with synthetic data☆75Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆77Updated 3 months ago
- Sample applications built on the Graphlit Platform☆74Updated 2 months ago
- ☆79Updated 2 weeks ago
- ☆20Updated last year
- ☆47Updated last year
- Your local personalised AI agent☆44Updated 6 months ago
- Starter app for creating an AI task completion agent with gmail capabilities.☆27Updated 11 months ago
- A couple scripts to grab stats from email☆42Updated 8 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆78Updated 2 months ago
- ☆45Updated last year
- Graphlit Platform☆19Updated last year
- ☆59Updated last year
- Record and replay LLM interactions for langchain☆82Updated 11 months ago
- converts url content into JSON with a simple prefix☆68Updated last year
- LLM-ready data connectors☆81Updated last year
- Reactive DDD with DSPy☆22Updated last year
- Natural Language Interfaces Powered by LLMs☆90Updated 10 months ago