uptrain-ai / uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
☆2,204Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for uptrain
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆668Updated 7 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,713Updated 3 months ago
- dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem…☆1,549Updated this week
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆781Updated 3 weeks ago
- The production toolkit for LLMs. Observability, prompt management and evaluations.☆1,081Updated this week
- High quality resources & applications for LLMs, multi-modal models and VectorDBs☆637Updated 2 weeks ago
- Open-source tool to visualise your RAG 🔮☆1,085Updated 8 months ago
- Data-Driven Evaluation for LLM-Powered Applications☆447Updated 2 months ago
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆675Updated 6 months ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆836Updated 10 months ago
- LLM fine-tuning and eval☆341Updated 8 months ago
- 🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt mana…☆1,947Updated this week
- Developer APIs to Accelerate LLM Projects☆1,438Updated last month
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆974Updated last week
- Python SDK for running evaluations on LLM generated responses☆221Updated this week
- LLM abstractions that aren't obstructions☆759Updated this week
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,017Updated this week
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆848Updated 2 weeks ago
- ☆744Updated 10 months ago
- The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.☆1,282Updated this week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,714Updated 3 months ago
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆856Updated this week
- LLM Testing SDK that helps you write and run tests to monitor your LLM app in production☆131Updated 9 months ago
- Open-source natural language enrichments at your fingertips.☆451Updated 7 months ago
- Ship RAG based LLM web apps in seconds.☆976Updated 9 months ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,268Updated this week
- An open-source ML pipeline development platform☆974Updated last month
- Harness LLMs with Multi-Agent Programming☆2,664Updated this week
- A tiny nearest-neighbor embedding database built with SQLite and Pytorch. (In development!)☆775Updated last year
- Build robust LLM applications with true composability 🔗☆416Updated 10 months ago