Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge:

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• miralab-ai / autoreason
  ☆41Updated 4 months ago
• lancedb / ragged
  ☆19Updated 6 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• langchain-ai / the-judge
  ☆29Updated 2 months ago
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• shadow-penguins / -KissanDial
  ☆1Updated 9 months ago
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆25Updated 5 months ago
• marib00 / llamaindex-embedding-lora
  ☆29Updated last year
• pavanjava / llama_workflow_and_agents
  This repository is a combination of llama workflows and agents together which is a powerful concept.
  ☆17Updated 8 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 7 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 3 weeks ago
• hwchase17 / chain-of-verification
  ☆32Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• jacoblee93 / oss-model-extraction-evals
  ☆32Updated last year
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• wenqiglantz / nemo-guardrails-llamaindex-rag
  Adding NeMo Guardrails to a LlamaIndex RAG pipeline
  ☆37Updated last year
• JGalego / RAGmap
  A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍
  ☆13Updated 3 weeks ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆45Updated 7 months ago
• wenqiglantz / hands-on-llamaindex
  A Hands-on Practical Guide to LlamaIndex
  ☆33Updated 6 months ago
• wenqiglantz / text-embedding-inference-server-edd
  Experimenting text-embeddings-inference server on both CPU and GPU
  ☆18Updated last year
• langchain-ai / langgraph-guardrails-example
  ☆13Updated 8 months ago
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 7 months ago
• SalesforceAIResearch / CRMArena
  CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments
  ☆54Updated 2 months ago
• vakyansh / gemma-experimentation
  Experimentation on google's gemma model
  ☆16Updated last year
• kmswin1 / Syntriever
  "Syntriever: How to Train Your Retriever with Synthetic Data from LLMs" the Nations of the Americas Chapter of the Association for Comput…
  ☆25Updated 2 months ago
• explodinggradients / Funtuner
  Supervised instruction finetuning for LLM with HF trainer and Deepspeed
  ☆35Updated last year
• nlp-uoregon / ullme
  ☆19Updated 3 weeks ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆53Updated 5 months ago