Alternatives and similar repositories for JudgeIt-LLM-as-a-Judge

Users that are interested in JudgeIt-LLM-as-a-Judge are comparing it to the libraries listed below

• ianhohoho / auto-hyde
  🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…
  ☆32Updated last year
• h2oai / h2o-LLM-eval
  Large-language Model Evaluation framework with Elo Leaderboard and A-B testing
  ☆52Updated 6 months ago
• SalesforceAIResearch / CRMArena
  CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments
  ☆55Updated 2 months ago
• DeepSoftwareAnalytics / Awesome-Agent4SE
  ☆93Updated 8 months ago
• jjovalle99 / DSPy-Text2SQL
  DSPY on action with OpenSource LLMs.
  ☆71Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 7 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆45Updated 7 months ago
• cxcscmu / RAGViz
  Official repository for RAGViz: Diagnose and Visualize Retrieval-Augmented Generation [EMNLP 2024]
  ☆82Updated 4 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• RUCAIBox / ChainLM
  ☆28Updated last year
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆76Updated 6 months ago
• TilmanLudewigtHaufe / GraphAugmented-Legal-RAG
  Create a knowledge graph out of unstructed legal text - use said knowledge graph in a graph augmented retrieval augmented generation pipe…
  ☆45Updated 7 months ago
• matthewrenze / self-reflection
  Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
  ☆73Updated 5 months ago
• EasyShopAI / rag-lab
  Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot
  ☆45Updated 7 months ago
• primeqa / clapnq
  ☆40Updated 3 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• mddunlap924 / LangChain-SynData-RAG-Eval
  LangChain, Llama2-Chat, and zero- and few-shot prompting are used to generate synthetic datasets for IR and RAG system evaluation
  ☆36Updated last year
• gersteinlab / Struc-Bench
  ☆52Updated 10 months ago
• Anni-Zou / Meta-CoT
  Meta-CoT: Generalizable Chain-of-Thought Prompting in Mixed-task Scenarios with Large Language Models
  ☆96Updated last year
• agiresearch / AutoFlow
  ☆67Updated 8 months ago
• wang-research-lab / agentinstruct
  Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"
  ☆110Updated 8 months ago
• explodinggradients / nemesis
  Reward Model framework for LLM RLHF
  ☆61Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆76Updated 6 months ago
• facebookresearch / ReasonIR
  Official repository for paper "ReasonIR Training Retrievers for Reasoning Tasks".
  ☆132Updated 2 weeks ago
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆57Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• nlp-uoregon / ullme
  ☆19Updated last month
• myeon9h / PlanRAG
  Repository for “PlanRAG: A Plan-then-Retrieval Augmented Generation for Generative Large Language Models as Decision Makers”, NAACL24
  ☆137Updated 11 months ago
• metal-chart-generation / metal
  ☆27Updated last month
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆53Updated this week