TrainLoop / evalsLinks
Open Source Data Collection and Evaluation Framework
☆61Updated 3 months ago
Alternatives and similar repositories for evals
Users that are interested in evals are comparing it to the libraries listed below
Sorting:
- ☆57Updated 7 months ago
- AI Agents for Enterprise Software Automation☆45Updated 9 months ago
- Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!☆49Updated 6 months ago
- A1Base NextJS template☆66Updated 4 months ago
- Taskiq plugin for postgres broker and results backend☆49Updated last week
- A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.☆229Updated 9 months ago
- 🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…☆52Updated 7 months ago
- Cloudstate is a JavaScript database runtime.☆202Updated 4 months ago
- Robot communication and coordination network.☆69Updated 5 months ago
- superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long tail and enterprise systems.☆1,914Updated last week
- Postman for MCP servers☆122Updated 2 months ago
- Prompt engineering, automated.☆346Updated 6 months ago
- Deploy Astro.js to freestyle.sh with cloudstate javascript object persistence.☆48Updated 8 months ago
- Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.☆329Updated last year
- ☆52Updated this week
- ☆142Updated 8 months ago
- CLI Tool for converting pydantic models into typescript definitions☆35Updated last year
- MentraOS is how you build smart glasses apps. And it's 100% open source. Get captions, AI assistant, notifications, translation, and more…☆1,439Updated this week
- A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…☆646Updated 5 months ago
- Open source payments + billing infrastructure☆431Updated this week
- Lilac is an open-source tool that ensures your data scientists always have enough gpus for their work. We seamlessly connect compute from…☆114Updated 2 months ago
- A Python library for LLM-based evaluation using weighted rubrics.☆36Updated this week
- Legacy project of an analytics platform for LLM-generated content☆435Updated 3 months ago
- The open source AI app collection☆182Updated last year
- A CLI for GPUs☆114Updated last week
- Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry☆361Updated this week
- ☆1,272Updated 2 months ago
- 🚀 Easy, open-source LLM finetuning with one-line commands, seamless cloud integration, and popular optimization frameworks. ✨☆95Updated last year
- Open-Sourcing the integration engine our platform runs on☆1,027Updated last week
- Find the best ML model for your use case | Y Combinator Fall 2024☆22Updated last year