Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• aws-samples / llm-based-advanced-summarization
  ☆50Updated 6 months ago
• JGalego / RAGmap
  A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍
  ☆13Updated 7 months ago
• patronus-ai / Lynx-hallucination-detection
  ☆43Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆51Updated last year
• lancedb / ragged
  ☆21Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 5 months ago
• darshil3011 / AutoMetaRAG
  Dynamic Metadata based RAG Framework
  ☆78Updated this week
• aws-samples / aiml-genai-multimodal-agent
  ☆53Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• SalesforceAIResearch / SFR-RAG
  ☆81Updated last month
• apple / ml-superposition-prompting
  ☆148Updated last year
• aws-samples / agentic-orchestration
  ☆23Updated 2 weeks ago
• aws-samples / llmops-workshop
  ☆24Updated last year
• qdrant / qdrant-rag-eval
  This repo is the central repo for all the RAG Evaluation reference material and partner workshop
  ☆77Updated 7 months ago
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆64Updated 4 months ago
• aws-samples / llm-evaluation-methodology
  ☆46Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 7 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆30Updated last year
• ianhohoho / auto-hyde
  🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…
  ☆33Updated last year
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆28Updated last year
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆90Updated 2 months ago
• Barneyjm / langchain-autotools
  Generate Tools and Toolkits from any Python SDK -- no extra code required
  ☆54Updated last year
• miralab-ai / autoreason
  ☆40Updated 11 months ago
• LeonEricsson / llmjudge
  Exploring limitations of LLM-as-a-judge
  ☆19Updated last year
• cohere-ai / cohere-aws
  ☆64Updated 7 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆50Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 4 months ago