Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
β326Jul 10, 2025Updated 11 months ago
Alternatives and similar repositories for tonic_validate
Users that are interested in tonic_validate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data-Driven Evaluation for LLM-Powered Applicationsβ516Jan 22, 2025Updated last year
- Supercharge Your LLM Application Evaluations πβ14,348Feb 24, 2026Updated 3 months ago
- Large Language Model (LLM) powered evaluator for Retrieval Augmented Generation (RAG) pipelines.β41Apr 29, 2024Updated 2 years ago
- Modified Beam Search with periodical restartβ12Sep 12, 2024Updated last year
- Automated Evaluation of RAG Systemsβ715Mar 28, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python SDK for running evaluations on LLM generated responsesβ300Jun 6, 2025Updated last year
- API server for converts hwp files - thanks to hwplib & hwpxlibβ13Jun 9, 2023Updated 3 years ago
- AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automationβ4,830Updated this week
- Evaluation and Tracking for LLM Experiments and AI Agentsβ3,379Updated this week
- Evaluation for AI apps and agentβ46Jan 18, 2024Updated 2 years ago
- RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Languaβ¦β433May 16, 2025Updated last year
- π’ Open-Source Evaluation & Testing library for LLM Agentsβ5,429Updated this week
- The LLM Evaluation Frameworkβ16,037Updated this week
- Build chatbots with GPT3. Write a text file, get a chat bot.β15Nov 19, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Benchmark baseline for retrieval qa applicationsβ121Apr 14, 2024Updated 2 years ago
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluationβ108Dec 16, 2024Updated last year
- Open-source RAG evaluation through users' feedbackβ220Apr 14, 2024Updated 2 years ago
- AI_Powered_Dev_Search_Engineβ12Mar 10, 2024Updated 2 years ago
- Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so yoβ¦β104Nov 24, 2023Updated 2 years ago
- AI Observability & Evaluationβ10,091Updated this week
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)β82Feb 13, 2025Updated last year
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroβ¦β3,037Feb 11, 2026Updated 4 months ago
- The backend behind the LLM-Perf Leaderboardβ11May 5, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Structured Outputsβ13,947May 18, 2026Updated 3 weeks ago
- Sentence Embedding as a Serviceβ15Jun 30, 2025Updated 11 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paperβ¦β114Apr 15, 2024Updated 2 years ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β70Nov 17, 2025Updated 6 months ago
- Efficient Retrieval Augmentation and Generation Frameworkβ1,780Jan 12, 2026Updated 5 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achβ¦β6,285Apr 8, 2026Updated 2 months ago
- Retrieval Augmented Generation Generalized Evaluation Datasetβ61Jul 16, 2025Updated 10 months ago
- Chain-of-thought λ°©μμ νμ©νμ¬ llama2λ₯Ό fine-tuningβ10Nov 18, 2023Updated 2 years ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-β¦β3,935May 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasetsβ211Mar 28, 2024Updated 2 years ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.β865Jan 15, 2024Updated 2 years ago
- β‘οΈA Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion πβ680Aug 7, 2025Updated 10 months ago
- Adding guardrails to large language models.β6,995Updated this week
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"β87Aug 12, 2024Updated last year
- Enable RNNLM lattice rescoring with Pytorch [kaldi]β12Jun 5, 2020Updated 6 years ago
- β12Updated this week