phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆83Updated last year
- auto fine tune of models with synthetic data☆75Updated last year
- AI real estate agent☆35Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆79Updated 9 months ago
- Python client library for improving your LLM app accuracy☆97Updated 9 months ago
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆88Updated this week
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- RAG example using DSPy, Gradio, FastAPI☆86Updated last year
- Develop, evaluate and monitor LLM applications at scale☆98Updated 11 months ago
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆151Updated last year
- Record and replay LLM interactions for langchain☆82Updated last year
- Open-source RAG evaluation through users' feedback☆207Updated last year
- GuardRail: Advanced tool for data analysis and AI content generation using OpenAI GPT models. Features sentiment analysis, content classi…☆135Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Your local personalised AI agent☆42Updated 11 months ago
- ☆61Updated last year
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- Natural Language Interfaces Powered by LLMs☆92Updated last year
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆133Updated last year
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated last year
- Code interpreter support for o1☆32Updated last year
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆74Updated last year
- converts url content into JSON with a simple prefix☆71Updated last year
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.☆115Updated last week
- Your automated SWE fleet to get your tickets from the Backlog to Prod!☆98Updated last year
- ☆93Updated last year
- 🌸 The open framework for question answering fine-tuning LLMs on private data☆69Updated 2 years ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆105Updated 10 months ago
- Logging and caching superpowers for the openai sdk☆105Updated last year