Alternatives and similar repositories for LLM-Evals-Catalogue

Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below

• hwchase17 / langfuzz
  ☆73Updated 11 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆112Updated last year
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆138Updated 3 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆140Updated this week
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆115Updated last month
• apple / ml-superposition-prompting
  ☆146Updated last year
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆130Updated this week
• cvs-health / langfair
  LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
  ☆232Updated 2 weeks ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• jjovalle99 / raft-well-architected
  ☆20Updated last year
• IBM / eval-assist
  EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…
  ☆80Updated this week
• pavanbelagatti / Multi-AI-Agent-Tutorial
  ☆37Updated last year
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆135Updated last month
• lz-chen / research-agent
  ☆89Updated 4 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆78Updated last week
• peremartra / FinLLMOpt
  Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.
  ☆51Updated 2 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆102Updated last month
• rungalileo / agent-leaderboard
  Ranking LLMs on agentic tasks
  ☆188Updated 2 weeks ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆117Updated this week
• saharmor / voice-lab
  Testing and evaluation framework for voice agents
  ☆150Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆147Updated last year
• lorenzejay / contract-analysis-use-case
  ☆35Updated 4 months ago
• tahreemrasul / semantic_research_engine
  A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…
  ☆83Updated last year
• rsrohan99 / dynamic-few-shot-llamaindex-workflow
  ☆53Updated 11 months ago
• run-llama / llama_extract
  ☆124Updated 7 months ago
• AI-ANK / RAGArch
  RAGArch is a Streamlit-based application that empowers users to experiment with various components and parameters of Retrieval-Augmented …
  ☆85Updated last year
• marib00 / llamaindex-embedding-lora
  ☆30Updated last year
• jkanalakis / deep-recall
  Enterprise-grade memory framework for LLMs featuring GPU-optimized inference, vector storage, and automated scaling. Enables hyper-person…
  ☆89Updated 4 months ago
• statice / awesome-synthetic-data
  A curated list of awesome synthetic data tools (open source and commercial).
  ☆208Updated last year