arthur-ai / benchLinks
A tool for evaluating LLMs
☆424Updated last year
Alternatives and similar repositories for bench
Users that are interested in bench are comparing it to the libraries listed below
Sorting:
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆398Updated last year
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆317Updated last month
- Fiddler Auditor is a tool to evaluate language models.☆185Updated last year
- Python SDK for running evaluations on LLM generated responses☆292Updated 2 months ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆938Updated 9 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆327Updated 9 months ago
- Continuous Integration for LLM powered applications☆249Updated 2 years ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆434Updated last year
- 🦜💯 Flex those feathers!☆252Updated 10 months ago
- ☆773Updated last month
- ☆460Updated last year
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆264Updated last year
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆657Updated this week
- ☆507Updated last year
- Data-Driven Evaluation for LLM-Powered Applications☆503Updated 7 months ago
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆305Updated 3 weeks ago
- ☆185Updated last year
- data cleaning and curation for unstructured text☆328Updated last year
- Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning☆312Updated 9 months ago
- Scale LLM Engine public repository☆809Updated last month
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆697Updated last year
- Automated Evaluation of RAG Systems☆643Updated 4 months ago
- Fine-Tuning Embedding for RAG with Synthetic Data☆509Updated last year
- Build robust LLM applications with true composability 🔗☆419Updated last year
- ⛓️ build cognitive systems, pythonic☆339Updated 9 months ago
- An Awesome list of curated DSPy resources.☆402Updated this week
- ☆174Updated last year
- An LLM-powered advanced RAG pipeline built from scratch☆847Updated last year
- Automatically evaluate your LLMs in Google Colab☆654Updated last year
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystack☆161Updated last week