uptrain-ai / uptrainLinks
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
☆2,327Updated last year
Alternatives and similar repositories for uptrain
Users that are interested in uptrain are comparing it to the libraries listed below
Sorting:
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,958Updated last year
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆861Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆959Updated 11 months ago
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆695Updated last year
- The simplest way to serve AI/ML models in production☆1,084Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,837Updated last week
- LLM Testing SDK that helps you write and run tests to monitor your LLM app in production☆131Updated last year
- Data-Driven Evaluation for LLM-Powered Applications☆511Updated 9 months ago
- Evaluation and Tracking for LLM Experiments and AI Agents☆2,912Updated this week
- Adding guardrails to large language models.☆5,970Updated last week
- Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.☆1,091Updated this week
- An open-source ML pipeline development platform☆996Updated 10 months ago
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆1,023Updated last year
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆864Updated last year
- A lightweight logger for machine learning teams to log images and predictions in production.☆154Updated 2 years ago
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,407Updated this week
- A language for constraint-guided and efficient LLM programming.☆4,081Updated 5 months ago
- A comprehensive guide to building RAG-based LLM applications for production.☆1,840Updated last year
- Turn expensive prompts into cheap fine-tuned models☆2,751Updated last year
- An open-source visual programming environment for battle-testing prompts to LLMs.☆2,876Updated this week
- AIConfig is a config-based framework to build generative AI applications.☆1,064Updated last year
- Developer APIs to Accelerate LLM Projects☆1,733Updated last year
- Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.☆1,019Updated this week
- Python SDK for running evaluations on LLM generated responses☆293Updated 5 months ago
- A tool for evaluating LLMs☆427Updated last year
- dstack is an open-source control plane for running development, training, and inference jobs on GPUs—across hyperscalers, neoclouds, or o…☆1,955Updated this week
- Prompt engineering for developers☆691Updated last year
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆705Updated 8 months ago
- AI Observability & Evaluation☆7,691Updated this week
- Classify and extract structured data with LLMs☆428Updated 2 years ago