Alternatives and similar repositories for evaluate-llms:

Users that are interested in evaluate-llms are comparing it to the libraries listed below

• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• NielsRogge / awesome-huggingface
  Repository containing awesome resources regarding Hugging Face tooling.
  ☆46Updated last year
• lancedb / ragged
  ☆18Updated 3 months ago
• pacman100 / peft-codegen-25
  ☆24Updated last year
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆99Updated 6 months ago
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated 10 months ago
• arcee-ai / DAM
  ☆46Updated 2 months ago
• AI-Maker-Space / Chainlit-Event-AIM
  A Chainlit App Used to Showcase: Async, Caching, Additional Chainlit Methods, and more!
  ☆11Updated 3 months ago
• kylegallatin / recsim
  A framework for simulating e-commerce data and interactions that can be used to build recommendation systems
  ☆10Updated last year
• evidentlyai / community-examples
  Examples of using Evidently to evaluate, test and monitor ML models.
  ☆18Updated last month
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆46Updated 10 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆76Updated 7 months ago
• padas-lab-de / ir-rag-sigir24-persona-rag
  ☆43Updated 3 months ago
• oceanumeric / EnteRAG
  A RAG that can scale 🧑🏻‍💻
  ☆11Updated 7 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 9 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago
• benediktstroebl / agent-evals
  ☆14Updated 3 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆74Updated 3 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆37Updated 10 months ago
• mrmps / ai-chunker
  Chunk your text using gpt4o-mini more accurately
  ☆43Updated 5 months ago
• deep-diver / TFX-WandB
  ☆14Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated 9 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆63Updated 2 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆34Updated last month
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆29Updated 4 months ago
• rungalileo / hallucination-index
  Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.
  ☆104Updated 4 months ago
• djliden / llmops-examples
  Example code and notebooks related to mlflow, llmops, etc.
  ☆41Updated 6 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆99Updated 3 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆49Updated 10 months ago