phospho-app / fastassert
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
☆27Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for fastassert
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆74Updated 2 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆79Updated 9 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆58Updated 7 months ago
- 🤖 Headless IDE for AI agents☆133Updated this week
- ☆129Updated 10 months ago
- ☆52Updated 2 months ago
- Testing and evaluation framework for voice agents☆54Updated this week
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆49Updated 2 weeks ago
- ☆43Updated 5 months ago
- LangEvals aggregates various language model evaluators into a single platform, providing a standard interface for a multitude of scores a…☆41Updated this week
- ☆48Updated last month
- A toolkit for building multimodal AI agents☆112Updated this week
- Annoucing Instructor Cloud☆34Updated 3 months ago
- OpenAI GPT hosted Agent Framework for Windows and MacOS☆36Updated 4 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆112Updated last month
- Open source AI analyst powered by E2B. Analyze your CSV files with Llama 3.1 and create interactive charts.☆45Updated this week
- Open-source RAG evaluation through users' feedback☆161Updated 7 months ago
- Code interpreter support for o1☆32Updated 2 months ago
- Starter app for creating an AI task completion agent with gmail capabilities.☆27Updated 5 months ago
- Code generator using LlamaIndexTS workflows with OpenAI o1 model☆42Updated 2 months ago
- LLM-ready data connectors☆63Updated 6 months ago
- Mine-tuning is a methodology for synchronizing human and AI attention.☆15Updated 5 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆57Updated 4 months ago
- Build your Swarm of Internet Agents using MultiOn 🚀☆77Updated 10 months ago
- Bridge ChatGPT with your system☆26Updated 4 months ago
- The long-term memory for your Superagents 🥷and LLMs 🤖. Built with GraphRAG, Knowledge graphs and autonomous ai agents☆47Updated 2 months ago
- auto fine tune of models with synthetic data☆72Updated 9 months ago
- Welcome to the Natural Language to SQL demo project using LlamaIndex! This application is designed to demonstrate the innovative use of L…☆67Updated 7 months ago
- sample app about authz and AI☆30Updated last week
- Ai power Dev using the rUv approach☆62Updated 3 weeks ago