TrainLoop / evalsLinks
Open Source Data Collection and Evaluation Framework
☆61Updated 4 months ago
Alternatives and similar repositories for evals
Users that are interested in evals are comparing it to the libraries listed below
Sorting:
- ☆58Updated 9 months ago
- AI Agents for Enterprise Software Automation☆44Updated 11 months ago
- Recipes for AI agents that use Asteroid to be safe and reliable. Want yours featured? Submit a PR!☆49Updated 7 months ago
- A1Base NextJS template☆66Updated this week
- Taskiq plugin for postgres broker and results backend☆52Updated this week
- A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.☆247Updated 10 months ago
- Codebase and CLI for PLAPT: A state-of-the-art protein-ligand binding affinity model for drug discovery☆109Updated 8 months ago
- 🐍 Sublingual helps you log and analyze all of your LLM calls, including the prompt template, call parameters, responses, tool calls, and…☆52Updated 9 months ago
- Cloudstate is a JavaScript database runtime.☆205Updated 5 months ago
- Prompt engineering, automated.☆350Updated 7 months ago
- Postman for MCP servers☆123Updated 4 months ago
- Generative UI SDK for React☆896Updated this week
- Serverless Posttraining☆63Updated this week
- ☆52Updated this week
- Ship billing in minutes, not weeks☆24Updated 2 months ago
- The open source AI app collection☆183Updated last year
- ☆140Updated 9 months ago
- Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.☆333Updated last year
- An experimental AI coding tool.☆567Updated last year
- Lilac is an open-source tool that ensures your data scientists always have enough gpus for their work. We seamlessly connect compute from…☆115Updated 3 months ago
- vscode extension to convert computationally intensive pytorch kernels to triton☆22Updated last year
- A Python library for LLM-based evaluation using weighted rubrics.☆39Updated last month
- EZQL ask your database questions using natural language.☆135Updated 10 months ago
- Robot communication and coordination network.☆69Updated 6 months ago
- Simple meeting diarization and speaker id assistant for meetings.☆11Updated 10 months ago
- Enriched Python function call graphs for agents and coding assistants☆122Updated 5 months ago
- CLI Tool for converting pydantic models into typescript definitions☆36Updated last year
- Legacy project of an analytics platform for LLM-generated content☆436Updated 4 months ago
- A fully customizable and self-hosted sandboxing solution for AI agent code execution and computer use. It features out-of-the-box support…☆715Updated 6 months ago
- superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long tail and enterprise systems.☆1,957Updated this week