Alternatives and similar repositories for LLMEvaluation:

Users that are interested in LLMEvaluation are comparing it to the libraries listed below

• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆120Updated 2 months ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆295Updated 2 months ago
• apple / ml-superposition-prompting
  ☆139Updated 6 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆259Updated 3 months ago
• AnswerDotAI / fastdata
  ☆147Updated 2 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆102Updated 4 months ago
• eugeneyan / visualizing-finetunes
  ☆77Updated 8 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 8 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆197Updated 4 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆313Updated 3 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆93Updated last month
• brandonstarxel / chunking_evaluation
  This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…
  ☆230Updated 4 months ago
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆253Updated last month
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆105Updated 5 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 7 months ago
• parlance-labs / ftcourse
  ☆165Updated 8 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆236Updated last week
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆101Updated 10 months ago
• jxnl / n-levels-of-rag
  ☆194Updated 9 months ago
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated 10 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆252Updated last month
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆101Updated 7 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆100Updated 10 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆179Updated 6 months ago
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆63Updated 11 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆106Updated this week
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆100Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 4 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 8 months ago