Alternatives and similar repositories for continuous-eval

Users that are interested in continuous-eval are comparing it to the libraries listed below

• zenbase-ai / core
  Prompt engineering, automated.
  ☆321Updated last month
• NeumTry / NeumAI
  Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
  ☆857Updated last year
• phospho-app / text-analytics-legacy
  Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, …
  ☆435Updated last week
• SciPhi-AI / agent-search
  AgentSearch is a framework for powering search agents and enabling customizable local search.
  ☆486Updated last year
• redotvideo / haven
  LLM fine-tuning and eval
  ☆346Updated last year
• athina-ai / athina-evals
  Python SDK for running evaluations on LLM generated responses
  ☆280Updated 2 weeks ago
• openfoundry-ai / model_manager
  Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.
  ☆322Updated last year
• Trainy-ai / llm-atc
  Fine-tuning and serving LLMs on any cloud
  ☆89Updated last year
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆419Updated last year
• dgarnitz / vectorflow
  VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…
  ☆693Updated last year
• npi-ai / npi
  Action library for AI Agent
  ☆214Updated 2 months ago
• ask-fini / paramount
  Agent accuracy measurements for LLMs
  ☆204Updated 11 months ago
• asf-transfer / burr
  Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…
  ☆1,616Updated this week
• automorphic-ai / aegis
  Self-hardening firewall for large language models
  ☆265Updated last year
• interlocklabs / trellis
  A simple DAG for executing LLM calls and using tools.
  ☆41Updated last year
• reworkd / bananalyzer
  Open source AI Agent evaluation framework for web tasks 🐒🍌
  ☆295Updated 5 months ago
• whyhow-ai / rule-based-retrieval
  The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applicati…
  ☆239Updated 7 months ago
• bananaml / fructose
  ☆744Updated last year
• superagent-ai / super-rag
  Super performant RAG pipelines for AI apps. Summarization, Retrieve/Rerank and Code Interpreters in one simple API.
  ☆374Updated last year
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆327Updated 9 months ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆300Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆116Updated last year
• jxnl / n-levels-of-rag
  ☆194Updated last year
• aryn-ai / sycamore
  🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
  ☆518Updated this week
• AI-Northstar-Tech / vector-io
  Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…
  ☆242Updated last week
• BerriAI / reliableGPT
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
  ☆652Updated last year
• AgentOps-AI / Jaiqu
  Automatically reformat any JSON into any schema with AI
  ☆330Updated 2 months ago
• wgryc / phasellm
  Large language model evaluation and workflow framework from Phase AI.
  ☆454Updated 4 months ago
• traceloop / openllmetry-js
  Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
  ☆319Updated last month
• pchunduri6 / rag-demystified
  An LLM-powered advanced RAG pipeline built from scratch
  ☆840Updated last year