Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆29Updated last year
• lancedb / ragged
  ☆20Updated 11 months ago
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆53Updated 2 months ago
• darshil3011 / AutoMetaRAG
  Dynamic Metadata based RAG Framework
  ☆75Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• JGalego / RAGmap
  A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍
  ☆13Updated 5 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• miralab-ai / autoreason
  ☆40Updated 9 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 6 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• SalesforceAIResearch / SFR-RAG
  ☆78Updated 8 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆45Updated last year
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated 2 years ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆118Updated 3 months ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆55Updated 3 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆74Updated 5 months ago
• aws-samples / llm-based-advanced-summarization
  ☆50Updated 4 months ago
• redis-developer / agentic-rag
  Complete example of how to build an Agentic RAG architecture with Redis, Amazon Bedrock, and LlamaIndex.
  ☆98Updated 10 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆32Updated last year
• jjovalle99 / agentic-design-patterns
  ☆14Updated last year
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆64Updated last month
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆50Updated last year
• aws-samples / llmops-workshop
  ☆24Updated 9 months ago
• mddunlap924 / LangChain-SynData-RAG-Eval
  LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
  ☆37Updated last year
• apple / ml-superposition-prompting
  ☆146Updated last year
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 5 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 8 months ago
• ali-bahrainian / RAG_best_practices
  ☆95Updated 6 months ago