Alternatives and similar repositories for evaluating-large-language-models-using-llm-as-a-judge:

Users that are interested in evaluating-large-language-models-using-llm-as-a-judge are comparing it to the libraries listed below

• lancedb / ragged
  ☆19Updated 6 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• miralab-ai / autoreason
  ☆41Updated 4 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 6 months ago
• aniket-work / AI_Powered_Dev_Search_Engine
  AI_Powered_Dev_Search_Engine
  ☆12Updated last year
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• shadow-penguins / -KissanDial
  ☆1Updated 9 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• wenqiglantz / text-embedding-inference-server-edd
  Experimenting text-embeddings-inference server on both CPU and GPU
  ☆18Updated last year
• gangiswag / infogent
  ☆20Updated last month
• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆21Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 6 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆53Updated 4 months ago
• thisishugow / create-llama-ollama
  a simple create-llama template using llama-index v0.10 and integrated with Ollama
  ☆10Updated 10 months ago
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆21Updated last week
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆45Updated 6 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆40Updated 2 months ago
• langchain-ai / langchain-cohere
  ☆39Updated this week
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• grounded-ai / grounded_ai
  ☆10Updated 6 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 5 months ago
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆17Updated 9 months ago
• kmswin1 / Syntriever
  "Syntriever: How to Train Your Retriever with Synthetic Data from LLMs" the Nations of the Americas Chapter of the Association for Comput…
  ☆24Updated last month
• nguyenkien1402 / llamaindex-practices
  This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/
  ☆40Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆23Updated 2 months ago
• benediktstroebl / agent-evals
  ☆16Updated 6 months ago