Alternatives and similar repositories for evaluate-llms

Users that are interested in evaluate-llms are comparing it to the libraries listed below

• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆156Updated last month
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• apple / ml-superposition-prompting
  ☆148Updated last year
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆115Updated 6 months ago
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆162Updated 2 weeks ago
• tahreemrasul / semantic_research_engine
  A semantic research engine to get relevant papers based on a user query. Application frontend with Chainlit Copilot. Observability with L…
  ☆82Updated last year
• PrithivirajDamodaran / Route0x
  Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da
  ☆119Updated 8 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆116Updated 4 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• VectorInstitute / fed-rag
  A framework for fine-tuning retrieval-augmented generation (RAG) systems.
  ☆137Updated this week
• AI-Maker-Space / Awesome-AIM-Index
  An index of all of our weekly concepts + code events for aspiring AI Engineers and Business Leaders!!
  ☆94Updated this week
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated last year
• katanaml / llm-ollama-llamaindex-invoice-cpu
  Data extraction with LLM on CPU
  ☆112Updated last year
• peremartra / FinLLMOpt
  Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.
  ☆50Updated 5 months ago
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆106Updated last year
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆130Updated this week
• ali-bahrainian / RAG_best_practices
  ☆103Updated 8 months ago
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆43Updated last week
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆71Updated last year
• predlico / ARAGOG
  ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…
  ☆114Updated last year
• run-llama / llama_extract
  ☆125Updated 9 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 8 months ago
• qdrant / qdrant-rag-eval
  This repo is the central repo for all the RAG Evaluation reference material and partner workshop
  ☆77Updated 7 months ago
• miptgirl / miptgirl_medium
  Code for Medium blog posts
  ☆101Updated last month
• mlabonne / how-to-data-science
  Scripts, notebooks, and articles about data science in general.
  ☆53Updated 2 years ago
• AhmedSSoliman / Llama2-CodeGen-Fine-Tuning-LLama-2
  ☆15Updated 2 years ago
• yai333 / Text-to-SQL-GRPO-Fine-tuning-Pipeline
  This repository contains a pipeline for fine-tuning Large Language Models (LLMs) for Text-to-SQL conversion using General Reward Proximal…
  ☆39Updated 8 months ago
• AntonioGr7 / pratical-llms
  A collection of hand on notebook for LLMs practitioner
  ☆51Updated 11 months ago
• anyscale / ray-summit-2023-training
  ☆89Updated 2 years ago