phospho-app / fastassertLinks
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated last year
Alternatives and similar repositories for fastassert
Users that are interested in fastassert are comparing it to the libraries listed below
Sorting:
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆84Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆78Updated 6 months ago
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆151Updated 10 months ago
- Develop, evaluate and monitor LLM applications at scale☆100Updated 9 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)☆84Updated 5 months ago
- AI real estate agent☆35Updated last year
- A starter app to build AI powered chat bots with Astra DB and LlamaIndex☆74Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆77Updated 10 months ago
- Legacy project☆440Updated last month
- ☆105Updated 2 months ago
- ☆93Updated last year
- Your local personalised AI agent☆42Updated 9 months ago
- Open-source RAG evaluation through users' feedback☆204Updated last year
- AI Operating System - Build your own AI using ontologies as the unifying field connecting data, models, workflows, and systems.☆62Updated last week
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆128Updated 10 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆147Updated last year
- Not Diamond Python SDK☆88Updated last week
- auto fine tune of models with synthetic data☆76Updated last year
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆104Updated 8 months ago
- low-code multi-agent automation framework☆256Updated last year
- Natural Language Interfaces Powered by LLMs☆94Updated last year
- Automated knowledge graph creation SDK☆122Updated 9 months ago
- ☆89Updated last year
- Record and replay LLM interactions for langchain☆82Updated last year
- Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.☆234Updated 10 months ago
- ☆102Updated last year
- A platform designed to facilitate the development of advanced conversational agents using retrieval augmented generation (RAG).☆34Updated last year
- ☆72Updated 10 months ago
- ☆60Updated last year