Alternatives and similar repositories for eval:

Users that are interested in eval are comparing it to the libraries listed below

• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆88Updated last year
• BerriAI / bettertest
  ☆75Updated last year
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last month
• hwchase17 / chain-of-verification
  ☆32Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆117Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆53Updated 5 months ago
• pinecone-io / pinecone-text
  Pinecone text client library
  ☆61Updated last month
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆61Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• venuv / LangSynth
  Conduct consumer interviews with synthetic focus groups using LLMs and LangChain
  ☆43Updated last year
• gururise / openai_text_generation_inference_server
  Use OpenAI with HuggingChat by emulating the text_generation_inference_server
  ☆43Updated last year
• DongjunLee / langdict
  Build complex LLM Applications with Python Dictionary
  ☆40Updated 6 months ago
• garg-ankush / scipe
  SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.
  ☆22Updated 6 months ago
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆21Updated last year
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 9 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• ajndkr / pytest-langchain
  ✅ Pytest-style test runner for langchain projects
  ☆25Updated 2 years ago
• swyxio / openlangmem
  ☆47Updated last year
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆51Updated 7 months ago
• shoggoth13 / langchain_model
  ☆20Updated last year
• rosewang2008 / backtracing
  Backtracing: Retrieving the Cause of the Query, EACL 2024 Long Paper, Findings.
  ☆89Updated 9 months ago
• chainyo / picaisso
  🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.
  ☆50Updated last year
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆30Updated 8 months ago
• embeddingstore / embedstore
  Hosted embedding platform to discover, evaluate, and retrieve embeddings
  ☆73Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 9 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year