uptrain-ai / uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
β2,259Updated 7 months ago
Alternatives and similar repositories for uptrain:
Users that are interested in uptrain are comparing it to the libraries listed below
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroβ¦β2,825Updated 7 months ago
- π LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). π Extracts signals from prompts & responses, ensuring saβ¦β895Updated 4 months ago
- LLMFlows - Simple, Explicit and Transparent LLM Appsβ691Updated last month
- πΉοΈ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboratioβ¦β2,777Updated 3 weeks ago
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.β832Updated 5 months ago
- LLM Testing SDK that helps you write and run tests to monitor your LLM app in productionβ131Updated last year
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.β2,242Updated this week
- LLM fine-tuning and evalβ345Updated last year
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.β853Updated last year
- π§ Motorhead is a memory and information retrieval server for LLMs.β869Updated 4 months ago
- The simplest way to serve AI/ML models in productionβ972Updated this week
- Build agents which are controlled by LLMsβ973Updated 3 months ago
- π’ Open-Source Evaluation & Testing for AI & LLM systemsβ4,442Updated this week
- Adding guardrails to large language models.β4,713Updated this week
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)β395Updated last year
- Distribute and run AI workloads magically in Python, like PyTorch for ML infra.β1,016Updated this week
- A comprehensive guide to building RAG-based LLM applications for production.β1,787Updated 8 months ago
- An LLM-powered advanced RAG pipeline built from scratchβ832Updated last year
- An awesome & curated list of best LLMOps tools for developersβ4,677Updated last week
- Self-hardening firewall for large language modelsβ264Updated last year
- Data-Driven Evaluation for LLM-Powered Applicationsβ486Updated 2 months ago
- Developer APIs to Accelerate LLM Projectsβ1,623Updated 5 months ago
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errorsβ650Updated last year
- Evaluation tool for LLM QA chainsβ1,073Updated last year
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastrβ¦β1,558Updated last week
- A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)β769Updated last year
- LLM Prompt Injection Detectorβ1,231Updated 8 months ago
- LLM(π½)β1,662Updated 2 months ago
- A language for constraint-guided and efficient LLM programming.β3,882Updated 10 months ago
- β764Updated last year