Alternatives and similar repositories for LLM-Evals-Catalogue

Users that are interested in LLM-Evals-Catalogue are comparing it to the libraries listed below

• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆156Updated 3 weeks ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆154Updated this week
• AI-Maker-Space / Awesome-AIM-Index
  An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!
  ☆91Updated last week
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆114Updated last year
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆115Updated 4 months ago
• hwchase17 / langfuzz
  ☆74Updated last year
• jjovalle99 / raft-well-architected
  ☆20Updated last year
• apple / ml-superposition-prompting
  ☆146Updated last year
• weaviate / gorilla
  Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.
  ☆138Updated 3 months ago
• IBM / eval-assist
  EvalAssist is an open-source project that simplifies using large language models as evaluators (LLM-as-a-Judge) of the output of other la…
  ☆92Updated last week
• CYQIQ / MultiCoT
  Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph
  ☆147Updated last year
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆136Updated this week
• cvs-health / langfair
  LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
  ☆242Updated last week
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆123Updated 3 weeks ago
• marib00 / llamaindex-embedding-lora
  ☆30Updated last year
• lz-chen / research-agent
  ☆89Updated 6 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆251Updated 9 months ago
• akashmathur-2212 / LLMs-playground
  What, Why and How of LLMs.
  ☆75Updated 2 months ago
• run-llama / llama_extract
  ☆124Updated 9 months ago
• lamini-ai / lamini-examples
  ☆163Updated 9 months ago
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆122Updated 9 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• qdrant / qdrant-rag-eval
  This repo is the central repo for all the RAG Evaluation reference material and partner workshop
  ☆76Updated 7 months ago
• pavanbelagatti / Multi-AI-Agent-Tutorial
  ☆38Updated last year
• misbahsy / RAGTune
  Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)
  ☆263Updated last year
• statice / awesome-synthetic-data
  A curated list of awesome synthetic data tools (open source and commercial).
  ☆222Updated last year
• spcl / knowledge-graph-of-thoughts
  Official Implementation of "Affordable AI Assistants with Knowledge Graph of Thoughts"
  ☆195Updated last month
• run-llama / llamaindex_aws_ingestion
  ☆89Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆167Updated last year
• whyhow-ai / whyhow
  Automated knowledge graph creation SDK
  ☆122Updated last year