Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆50Updated last month
• JGalego / RAGmap
  A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍
  ☆13Updated 5 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated 11 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆50Updated 11 months ago
• SalesforceAIResearch / SFR-RAG
  ☆76Updated 8 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• lancedb / ragged
  ☆20Updated 11 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 5 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• enguard-ai / awesome-ai-guardails
  A curated list of materials on AI guardails
  ☆40Updated 3 months ago
• miralab-ai / autoreason
  ☆40Updated 9 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆29Updated last year
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆114Updated 2 months ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 2 months ago
• darshil3011 / AutoMetaRAG
  Dynamic Metadata based RAG Framework
  ☆75Updated last year
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 5 months ago
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆32Updated last year
• ianhohoho / auto-hyde
  🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…
  ☆32Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆72Updated 5 months ago
• aws-samples / llm-based-advanced-summarization
  ☆50Updated 4 months ago
• apple / ml-superposition-prompting
  ☆145Updated last year
• aws-samples / llmops-workshop
  ☆24Updated 9 months ago
• javyduck / KnowHalu
  ☆48Updated last year
• langchain-ai / the-judge
  ☆37Updated 7 months ago
• aws-samples / agentic-orchestration
  ☆22Updated 9 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆45Updated last year
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆26Updated 9 months ago
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆17Updated last year