phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆151Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆79Updated 8 months ago
- AI real estate agent☆35Updated last year
- Python client library for improving your LLM app accuracy☆97Updated 8 months ago
- auto fine tune of models with synthetic data☆75Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆88Updated last month
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆74Updated last year
- converts url content into JSON with a simple prefix☆71Updated last year
- Natural Language Interfaces Powered by LLMs☆92Updated last year
- Open-source RAG evaluation through users' feedback☆206Updated last year
- A Python package to dynamically load functions for OpenAI Assistant☆54Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- ☆73Updated last year
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆53Updated 11 months ago
- Record and replay LLM interactions for langchain☆82Updated last year
- Code interpreter support for o1☆32Updated last year
- Data Questionnaire Agent Chatbot☆69Updated last week
- A microframework for creating simple AI agents.☆91Updated last year
- Automated knowledge graph creation SDK☆122Updated 10 months ago
- Develop, evaluate and monitor LLM applications at scale☆98Updated 10 months ago
- Legacy project of an analytics platform for LLM-generated content☆436Updated 3 months ago
- Use dynamic few-shot selection to tweet in a particular style☆30Updated last year
- GuardRail: Advanced tool for data analysis and AI content generation using OpenAI GPT models. Features sentiment analysis, content classi…☆135Updated last year
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆185Updated 10 months ago
- Not Diamond Python SDK☆89Updated this week
- Sample applications built on the Graphlit Platform☆75Updated last week
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆132Updated last year
- RAG example using DSPy, Gradio, FastAPI☆85Updated last year
- ☆61Updated last year
- ☆89Updated last year