Alternatives and similar repositories for continuous-eval

Users that are interested in continuous-eval are comparing it to the libraries listed below

• phospho-app / text-analytics-legacy
  Legacy project of an analytics platform for LLM-generated content
  ☆439Updated 6 months ago
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆295Updated 8 months ago
• NeumTry / NeumAI
  Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
  ☆867Updated 2 years ago
• zenbase-ai / core
  Prompt engineering, automated.
  ☆352Updated 9 months ago
• redotvideo / haven
  LLM fine-tuning and eval
  ☆348Updated last year
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆517Updated last year
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆91Updated 2 years ago
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆265Updated 2 weeks ago
• dgarnitz / vectorflow
  VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…
  ☆701Updated last year
• ask-fini / paramount
  Agent accuracy measurements for LLMs
  ☆204Updated last year
• automorphic-ai / aegis
  Self-hardening firewall for large language models
  ☆267Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆428Updated last year
• bananaml / fructose
  ☆748Updated last year
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆337Updated last year
• pchunduri6 / rag-demystified
  An LLM-powered advanced RAG pipeline built from scratch
  ☆856Updated 2 years ago
• sheet0 / npi
  Action library for AI Agent
  ☆229Updated 10 months ago
• Tanuki / tanuki.py
  Prompt engineering for developers
  ☆695Updated last year
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆250Updated last year
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆323Updated 6 months ago
• stoyan-stoyanov / llmflows
  LLMFlows - Simple, Explicit and Transparent LLM Apps
  ☆708Updated 11 months ago
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆1,095Updated this week
• tigerlab-ai / tiger
  Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)
  ☆399Updated 2 years ago
• BerriAI / reliableGPT
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
  ☆695Updated 2 years ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆319Updated 2 years ago
• palico-ai / palico-ai
  Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework
  ☆341Updated last year
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆585Updated this week
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆326Updated last year
• apache / burr
  Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…
  ☆1,908Updated last week
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆1,043Updated 11 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆248Updated last year