empirical-run / empirical
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
β155Updated 6 months ago
Alternatives and similar repositories for empirical:
Users that are interested in empirical are comparing it to the libraries listed below
- πOpen source pricing and billing infrastructure to support any pricing model, from usage-based to subscription and everything in betweenβ¦β128Updated this week
- Run Open Source/Open Weight LLMs locally with OpenAI compatible APIsβ94Updated last month
- ActBot is a prototype for an injectable chatbot to give any website agentic capabilitiesβ59Updated 9 months ago
- LLM-ready data connectorsβ72Updated 9 months ago
- rerank library for easy reranking of resultsβ36Updated 5 months ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, baβ¦β229Updated this week
- Your automated SWE fleet to get your tickets from the Backlog to Prod!β96Updated 10 months ago
- A curated list of open source repositories for AI Engineersβ107Updated 2 weeks ago
- Personal memory for AIβ56Updated 9 months ago
- vscode extension to convert computationally intensive pytorch kernels to tritonβ22Updated 5 months ago
- Work with web-enabled agents quickly β whether running a quick task or bootstrapping a full-stack product.β92Updated 4 months ago
- Prompt engineering, automated.β287Updated 3 months ago
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasksβ32Updated 9 months ago
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.β49Updated 5 months ago
- LLM Evals for Text Summarization and RAG use-cases.β35Updated last year
- Superpipe - optimized LLM pipelines for structured dataβ108Updated 8 months ago
- β58Updated 4 months ago
- Lightweight open-source perplexityβ62Updated 10 months ago
- Fluid Databaseβ114Updated 5 months ago
- visually integration test your backendβ148Updated 7 months ago
- Cloudstate is a JavaScript database runtime.β171Updated last week
- Open source subtitling platform π» for transcribing and translating videos/audios in Indic languages.β87Updated last week
- The open source AI app collectionβ177Updated last year
- Python SDK for running evaluations on LLM generated responsesβ270Updated this week
- β145Updated last month
- A simple DAG for executing LLM calls and using tools.β41Updated last year
- β29Updated 4 months ago
- A sample Personal Finance Management app built on the Account Aggregator framework.β64Updated 3 years ago
- Open source NLA. Hosted service in private beta, signup now! Alternative to Zapier NLAβ30Updated last year
- Foyle is a copilot to help developers deploy and operate their applications.β121Updated last month