Alternatives and similar repositories for eval:

Users that are interested in eval are comparing it to the libraries listed below

• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆88Updated last year
• hwchase17 / chain-of-verification
  ☆30Updated last year
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆59Updated 9 months ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆116Updated last year
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆112Updated 4 months ago
• nexusflowai / nexusraven-pip
  ☆38Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆63Updated last year
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆21Updated 10 months ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆47Updated 10 months ago
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆221Updated 7 months ago
• MantisAI / hugie
  Command Line Interface for Hugging Face Inference Endpoints
  ☆67Updated 10 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• pinecone-io / pinecone-text
  Pinecone text client library
  ☆59Updated last week
• gururise / openai_text_generation_inference_server
  Use OpenAI with HuggingChat by emulating the text_generation_inference_server
  ☆45Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆100Updated 10 months ago
• jina-ai / jerboa
  LLM finetuning
  ☆42Updated last year
• langchain-ai / kork
  Natural Language Interfaces Powered by LLMs
  ☆91Updated 6 months ago
• shoggoth13 / agents-deconstructed
  ☆57Updated last year
• venuv / LangSynth
  Conduct consumer interviews with synthetic focus groups using LLMs and LangChain
  ☆43Updated last year
• chainyo / picaisso
  🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.
  ☆50Updated last year
• BerriAI / bettertest
  ☆75Updated last year
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆96Updated this week
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆64Updated 3 months ago
• weavel-ai / promptmodel-python
  Prompt & model versioning on the cloud
  ☆10Updated 7 months ago
• seonglae / llama2gptq
  Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quant…
  ☆29Updated last year
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆29Updated 5 months ago
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated 11 months ago
• homanp / gcp-langchain
  Example of running LangChain on Cloud Run
  ☆61Updated last year
• DongjunLee / langdict
  Build complex LLM Applications with Python Dictionary
  ☆38Updated 4 months ago