Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge:

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• lancedb / ragged
  ☆18Updated 5 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• shadow-penguins / -KissanDial
  ☆1Updated 8 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• TuanaCelik / unstructuredio-haystack
  💙 Unstructured Data Connectors for Haystack 2.0
  ☆16Updated last year
• darshil3011 / AutoMetaRAG
  Dynamic Metadata based RAG Framework
  ☆72Updated 7 months ago
• miralab-ai / autoreason
  ☆41Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆38Updated 11 months ago
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆33Updated 3 weeks ago
• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆20Updated last week
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 5 months ago
• cognitivecomputations / SystemChat
  ☆30Updated 8 months ago
• langchain-ai / langchain-cohere
  ☆38Updated last week
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆34Updated last year
• redis-developer / agentic-rag
  Complete example of how to build an Agentic RAG architecture with Redis, Amazon Bedrock, and LlamaIndex.
  ☆91Updated 3 months ago
• vakyansh / gemma-experimentation
  Experimentation on google's gemma model
  ☆16Updated last year
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆16Updated 8 months ago
• google / rag-playground
  ☆30Updated 2 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 4 months ago
• aniketmaurya / Agents
  Build Agentic workflows with function calling using open LLMs
  ☆26Updated 2 weeks ago
• v-prgmr / mergekit
  Tools for merging pretrained large language models.
  ☆19Updated 9 months ago
• benediktstroebl / agent-evals
  ☆15Updated 5 months ago
• aniket-work / AI_Powered_Dev_Search_Engine
  AI_Powered_Dev_Search_Engine
  ☆12Updated last year