empirical-run / empiricalLinks
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
☆158Updated 10 months ago
Alternatives and similar repositories for empirical
Users that are interested in empirical are comparing it to the libraries listed below
Sorting:
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆249Updated this week
- Foyle is a copilot to help developers deploy and operate their applications.☆131Updated 4 months ago
- Prompt engineering, automated.☆331Updated 2 months ago
- Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs☆114Updated 2 weeks ago
- Superpipe - optimized LLM pipelines for structured data☆110Updated last year
- ☆74Updated 8 months ago
- Python SDK for running evaluations on LLM generated responses☆289Updated last month
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆52Updated 9 months ago
- Your automated SWE fleet to get your tickets from the Backlog to Prod!☆98Updated last year
- Perform transformations on your data with natural language using LLMs☆85Updated this week
- ActBot is a prototype for an injectable chatbot to give any website agentic capabilities☆58Updated last year
- Repository for fine-tuning gemma models using unsloth for indic languages☆95Updated last year
- A curated list of open source repositories for AI Engineers☆116Updated 3 months ago
- Fluid Database☆114Updated 9 months ago
- Detect and redact PII locally with SOTA performance☆58Updated 3 months ago
- ☆146Updated last week
- ☆195Updated last year
- rerank library for easy reranking of results☆47Updated 10 months ago
- ☆11Updated 4 months ago
- ☆63Updated last year
- Solving data for LLMs - Create quality synthetic datasets!☆150Updated 5 months ago
- Logging and caching superpowers for the openai sdk☆105Updated last year
- This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…☆151Updated 9 months ago
- A collection of LLM services you can self host via docker or modal labs to support your applications development☆191Updated last year
- Use the OpenAI Batch tool to make async batch requests to the OpenAI API.☆99Updated last year
- The Identity layer for the agentic world☆196Updated this week
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆37Updated last year
- Work with web-enabled agents quickly — whether running a quick task or bootstrapping a full-stack product.☆93Updated 8 months ago
- Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.☆106Updated this week
- converts url content into JSON with a simple prefix☆70Updated last year