empirical-run / empirical
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
☆155Updated 7 months ago
Alternatives and similar repositories for empirical:
Users that are interested in empirical are comparing it to the libraries listed below
- LLM-ready data connectors☆74Updated 10 months ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆231Updated last week
- vscode extension to convert computationally intensive pytorch kernels to triton☆22Updated 5 months ago
- Web SDKs for 100ms☆30Updated last week
- Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs☆94Updated last month
- Your automated SWE fleet to get your tickets from the Backlog to Prod!☆96Updated 11 months ago
- 🌟Open source pricing and billing infrastructure to support any pricing model, from usage-based to subscription and everything in between…☆135Updated this week
- ActBot is a prototype for an injectable chatbot to give any website agentic capabilities☆59Updated 10 months ago
- rerank library for easy reranking of results☆37Updated 6 months ago
- Build reliable, secure, and production-ready AI apps easily.☆68Updated last week
- Hitchcock a multi-agent movie maker, powered by mahilo☆64Updated last month
- Prompt engineering, automated.☆288Updated 4 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆50Updated 5 months ago
- Foyle is a copilot to help developers deploy and operate their applications.☆121Updated last week
- A simple DAG for executing LLM calls and using tools.☆41Updated last year
- Logging and caching superpowers for the openai sdk☆103Updated last year
- visually integration test your backend☆148Updated 7 months ago
- ☆29Updated 5 months ago
- A curated list of open source repositories for AI Engineers☆108Updated last week
- The open source AI app collection☆177Updated last year
- ☆59Updated 4 months ago
- npm like package ecosystem for Prompts 🤖☆49Updated last month
- Open source subtitling platform 💻 for transcribing and translating videos/audios in Indic languages.☆87Updated 3 weeks ago
- Fluid Database☆114Updated 6 months ago
- Build AI Agents with Your Existing Python Code!☆55Updated 5 months ago
- Cedana: Access and run on compute anywhere in the world, on any provider. Migrate seamlessly between providers, arbitraging price/perform…☆58Updated last week
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆33Updated 9 months ago
- ☆11Updated last month
- Simple AI coder that can do most of my work for me, including working on himself.☆234Updated last month
- Python SDK for running evaluations on LLM generated responses☆272Updated last week