Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
β325Jul 10, 2025Updated 10 months ago
Alternatives and similar repositories for tonic_validate
Users that are interested in tonic_validate are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data-Driven Evaluation for LLM-Powered Applicationsβ516Jan 22, 2025Updated last year
- Supercharge Your LLM Application Evaluations πβ13,996Feb 24, 2026Updated 3 months ago
- Modified Beam Search with periodical restartβ12Sep 12, 2024Updated last year
- Automated Evaluation of RAG Systemsβ710Mar 28, 2025Updated last year
- Python SDK for running evaluations on LLM generated responsesβ300Jun 6, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- API server for converts hwp files - thanks to hwplib & hwpxlibβ12Jun 9, 2023Updated 2 years ago
- AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automationβ4,784Updated this week
- Evaluation and Tracking for LLM Experiments and AI Agentsβ3,338Updated this week
- RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Languaβ¦β429May 16, 2025Updated last year
- π’ Open-Source Evaluation & Testing library for LLM Agentsβ5,363Updated this week
- π¦π― Flex those feathers!β256Oct 21, 2024Updated last year
- The LLM Evaluation Frameworkβ15,497May 14, 2026Updated last week
- Build chatbots with GPT3. Write a text file, get a chat bot.β15Nov 19, 2022Updated 3 years ago
- Benchmark baseline for retrieval qa applicationsβ121Apr 14, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluationβ108Dec 16, 2024Updated last year
- Open-source RAG evaluation through users' feedbackβ217Apr 14, 2024Updated 2 years ago
- AI_Powered_Dev_Search_Engineβ12Mar 10, 2024Updated 2 years ago
- Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so yoβ¦β104Nov 24, 2023Updated 2 years ago
- AI Observability & Evaluationβ9,735Updated this week
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)β82Feb 13, 2025Updated last year
- Develop pro-code personal agents integrated with memory service on Teamsβ28Updated this week
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroβ¦β3,037Feb 11, 2026Updated 3 months ago
- The backend behind the LLM-Perf Leaderboardβ11May 5, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Structured Outputsβ13,846May 13, 2026Updated last week
- Sentence Embedding as a Serviceβ15Jun 30, 2025Updated 10 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paperβ¦β113Apr 15, 2024Updated 2 years ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β70Nov 17, 2025Updated 6 months ago
- Efficient Retrieval Augmentation and Generation Frameworkβ1,779Jan 12, 2026Updated 4 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achβ¦β6,209Apr 8, 2026Updated last month
- Retrieval Augmented Generation Generalized Evaluation Datasetβ61Jul 16, 2025Updated 10 months ago
- Chain-of-thought λ°©μμ νμ©νμ¬ llama2λ₯Ό fine-tuningβ10Nov 18, 2023Updated 2 years ago
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-β¦β3,924May 17, 2025Updated last year
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Knowledge Graph Retrieval Augmented Generation (KG-RAG) Eval Datasetsβ208Mar 28, 2024Updated 2 years ago
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.β172Nov 18, 2024Updated last year
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.β866Jan 15, 2024Updated 2 years ago
- β‘οΈA Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion πβ678Aug 7, 2025Updated 9 months ago
- Adding guardrails to large language models.β6,883May 13, 2026Updated last week
- Enable RNNLM lattice rescoring with Pytorch [kaldi]β12Jun 5, 2020Updated 5 years ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"β87Aug 12, 2024Updated last year