Alternatives and similar repositories for LLMEvaluation:

Users that are interested in LLMEvaluation are comparing it to the libraries listed below

• apple / ml-superposition-prompting
  ☆142Updated 8 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆107Updated 6 months ago
• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆123Updated 3 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated 11 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆265Updated 4 months ago
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆101Updated last week
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• AnswerDotAI / fastdata
  ☆150Updated 3 months ago
• eugeneyan / visualizing-finetunes
  ☆77Updated 9 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 9 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 8 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆105Updated 5 months ago
• fiddler-labs / fiddler-auditor
  Fiddler Auditor is a tool to evaluate language models.
  ☆177Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆75Updated 6 months ago
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated 11 months ago
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆103Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 7 months ago
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆102Updated 11 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆183Updated last week
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆316Updated 4 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆104Updated 8 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• jjallaire / inspect-llm-workshop
  ☆51Updated 9 months ago
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆44Updated 7 months ago
• cvs-health / langfair
  LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
  ☆184Updated 2 weeks ago
• deep-diver / llamaduo
  This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.
  ☆302Updated last month
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆99Updated last year