Alternatives and similar repositories for eval:

Users that are interested in eval are comparing it to the libraries listed below

• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆88Updated last year
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• gururise / openai_text_generation_inference_server
  Use OpenAI with HuggingChat by emulating the text_generation_inference_server
  ☆43Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated last year
• pinecone-io / pinecone-text
  Pinecone text client library
  ☆61Updated last month
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆117Updated last year
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆30Updated 7 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• BerriAI / bettertest
  ☆75Updated last year
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆50Updated 6 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week
• yisding / llmon
  LLMON (pronounced limón) is a structured data format optimized for large language models
  ☆34Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• chainyo / picaisso
  🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.
  ☆50Updated last year
• DongjunLee / langdict
  Build complex LLM Applications with Python Dictionary
  ☆39Updated 6 months ago
• voyage-ai / voyageai-python
  Voyage AI Official Python Library
  ☆57Updated 4 months ago
• MantisAI / hugie
  Command Line Interface for Hugging Face Inference Endpoints
  ☆66Updated last year
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆21Updated last year
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆61Updated 11 months ago
• weaviate / weaviate-podcast-search
  Search through the Weaviate Podcast!
  ☆56Updated 3 months ago
• shoggoth13 / langchain_model
  ☆20Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆53Updated 4 months ago
• weavel-ai / promptmodel-python
  Prompt & model versioning on the cloud
  ☆10Updated 9 months ago
• deep-diver / hllama
  hllama is a library which aims to provide a set of utility tools for large language models.
  ☆10Updated last year
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• NirantK / agentai
  Text to Python Objects via a LLM Function Call
  ☆57Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆149Updated 6 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆223Updated 9 months ago
• venuv / LangSynth
  Conduct consumer interviews with synthetic focus groups using LLMs and LangChain
  ☆43Updated last year