Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• aws-samples / llmops-workshop
  ☆24Updated last year
• JGalego / RAGmap
  A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍
  ☆13Updated 8 months ago
• aws-samples / aiml-genai-multimodal-agent
  ☆54Updated last year
• microsoft / llm-steer-instruct
  A method for steering llms to better follow instructions
  ☆74Updated 5 months ago
• aws-samples / llm-evaluation-methodology
  ☆46Updated last year
• aws-samples / llm-based-advanced-summarization
  ☆52Updated 7 months ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆56Updated 6 months ago
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆28Updated last year
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆31Updated 2 years ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆54Updated last year
• patronus-ai / Lynx-hallucination-detection
  ☆42Updated last year
• FareedKhan-dev / 14-rag-failures
  Encountering 14 different Naive RAG fails and using KG to solve it
  ☆15Updated last month
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆127Updated 2 months ago
• PacktPublishing / Generative-AI-with-Amazon-Bedrock
  Generative AI with Amazon Bedrock, published by Packt
  ☆27Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• mddunlap924 / LangChain-SynData-RAG-Eval
  LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
  ☆38Updated 2 years ago
• OpenPipe / open_deep_research_training
  Training setup for Langchain's Open Deep Research
  ☆74Updated 4 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆80Updated last year
• apple / ml-superposition-prompting
  ☆147Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆30Updated 2 years ago
• cohere-ai / cohere-aws
  ☆64Updated 8 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• aws-samples / agentic-orchestration
  ☆23Updated last month
• SalesforceAIResearch / SFR-RAG
  ☆82Updated 2 months ago
• aws-samples / AI-search-with-amazon-opensearch-service
  ☆70Updated last month
• tahreemrasul / semantic_research_engine
  A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…
  ☆81Updated last year
• choosewhatulike / case2code
  ☆17Updated 9 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 8 months ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆90Updated 3 months ago
• LeonEricsson / llmjudge
  Exploring limitations of LLM-as-a-judge
  ☆19Updated last year