Alternatives and similar repositories for LLMEvaluation:

Users that are interested in LLMEvaluation are comparing it to the libraries listed below

• apple / ml-superposition-prompting
  ☆143Updated 9 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆107Updated 7 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆124Updated 2 weeks ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆179Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆278Updated 6 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆102Updated last month
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆304Updated last month
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆277Updated last week
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆108Updated 3 weeks ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆102Updated last year
• PAIR-code / llm-comparator
  LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…
  ☆417Updated 2 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• AnswerDotAI / fastdata
  ☆151Updated 5 months ago
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆110Updated this week
• patronus-ai / Lynx-hallucination-detection
  ☆36Updated 9 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 10 months ago
• eugeneyan / llm-paper-notes
  Notes from the Latent Space paper club. Follow along or start your own!
  ☆230Updated 9 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆273Updated 9 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• quotient-ai / judges
  A small library of LLM judges
  ☆185Updated last week
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆108Updated 7 months ago
• FourthBrain / Building-with-Instruction-Tuned-LLMs-A-Step-by-Step-Guide
  Resources relating to the DLAI event: https://www.youtube.com/watch?v=eTieetk2dSw
  ☆184Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆193Updated this week
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 11 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆320Updated 5 months ago
• jxnl / n-levels-of-rag
  ☆195Updated last year