Alternatives and similar repositories for eval

Users that are interested in eval are comparing it to the libraries listed below

• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆90Updated last year
• gururise / openai_text_generation_inference_server
  Use OpenAI with HuggingChat by emulating the text_generation_inference_server
  ☆44Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆116Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• DongjunLee / langdict
  Build complex LLM Applications with Python Dictionary
  ☆40Updated 8 months ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated 2 years ago
• BerriAI / bettertest
  ☆75Updated last year
• philschmid / text-generation-inference-tests
  ☆19Updated last year
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆61Updated last year
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆78Updated last week
• pinecone-io / pinecone-text
  Pinecone text client library
  ☆62Updated 3 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆54Updated 2 months ago
• hwchase17 / chain-of-verification
  ☆32Updated last year
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆40Updated last year
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆52Updated 8 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆104Updated 6 months ago
• chainyo / picaisso
  🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.
  ☆50Updated 2 years ago
• deep-diver / auto-paper-analysis
  ☆35Updated last year
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆31Updated 10 months ago
• taylorai / onnx_embedding_models
  utilities for loading and running text embeddings with onnx
  ☆44Updated 10 months ago
• shoggoth13 / langchain_model
  ☆20Updated last year
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆22Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• ajndkr / pytest-langchain
  ✅ Pytest-style test runner for langchain projects
  ☆25Updated 2 years ago
• normandmickey / MrsStax
  ☆63Updated 2 years ago