uptrain-ai / uptrainLinks
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
☆2,338Updated last year
Alternatives and similar repositories for uptrain
Users that are interested in uptrain are comparing it to the libraries listed below
Sorting:
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆975Updated last year
- Adding guardrails to large language models.☆6,297Updated this week
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,998Updated last year
- Data-Driven Evaluation for LLM-Powered Applications☆516Updated last year
- Evaluation and Tracking for LLM Experiments and AI Agents☆3,060Updated this week
- Turn expensive prompts into cheap fine-tuned models☆2,770Updated last year
- 🐢 Open-Source Evaluation & Testing library for LLM Agents☆5,087Updated this week
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆699Updated last year
- The simplest way to serve AI/ML models in production☆1,109Updated this week
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆1,027Updated last year
- A tool for evaluating LLMs☆428Updated last year
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,458Updated this week
- LLM(😽)☆1,698Updated 11 months ago
- Prompt engineering for developers☆695Updated last year
- A lightweight logger for machine learning teams to log images and predictions in production.☆155Updated 2 years ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,889Updated last week
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆867Updated 2 years ago
- LLM Testing SDK that helps you write and run tests to monitor your LLM app in production☆132Updated 2 years ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,538Updated this week
- An open-source ML pipeline development platform☆999Updated last year
- An LLM-powered advanced RAG pipeline built from scratch☆856Updated 2 years ago
- LLM fine-tuning and eval☆348Updated last year
- APIs to run user code in any developer product☆117Updated 2 years ago
- AI Observability & Evaluation☆8,336Updated this week
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆868Updated last year
- Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.☆1,047Updated this week
- A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…☆1,043Updated 11 months ago
- Classify and extract structured data with LLMs☆428Updated 2 years ago
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆693Updated 2 years ago
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆399Updated 2 years ago