chroma-core / generative-benchmarkingLinks
☆46Updated 3 weeks ago
Alternatives and similar repositories for generative-benchmarking
Users that are interested in generative-benchmarking are comparing it to the libraries listed below
Sorting:
- Official Repo for CRMArena and CRMArena-Pro☆126Updated last month
- Python library to use Pleias-RAG models☆67Updated 7 months ago
- Collection of resources for RL and Reasoning☆26Updated 10 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated last week
- Attribute (or cite) statements generated by LLMs back to in-context information.☆305Updated last year
- This is the repo for the LegalBench-RAG Paper: https://arxiv.org/abs/2408.10343.☆143Updated 6 months ago
- ☆148Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆71Updated last year
- MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]☆193Updated 3 months ago
- A small library of LLM judges☆306Updated 4 months ago
- Inference-time scaling for LLMs-as-a-judge.☆316Updated last month
- Source code for our paper: "SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals".☆70Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆117Updated last month
- awesome synthetic (text) datasets☆314Updated 3 weeks ago
- Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖☆76Updated last year
- A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …☆61Updated 10 months ago
- Generalist and Lightweight Model for Text Classification☆166Updated last week
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆124Updated last month
- ☆120Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- ☆200Updated 2 weeks ago
- XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.☆173Updated 7 months ago
- Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)☆124Updated 10 months ago
- A Lightweight Library for AI Observability☆252Updated 9 months ago
- ☆87Updated last week
- The first dense retrieval model that can be prompted like an LM☆89Updated 7 months ago
- CiteME is a benchmark designed to test the abilities of language models in finding papers that are cited in scientific texts.☆48Updated last month
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆139Updated 3 months ago