uptrain-ai / uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
☆2,263Updated 9 months ago
Alternatives and similar repositories for uptrain
Users that are interested in uptrain are comparing it to the libraries listed below
Sorting:
- Turn expensive prompts into cheap fine-tuned models☆2,591Updated 11 months ago
- A tool for evaluating LLMs☆419Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆908Updated 5 months ago
- Data-Driven Evaluation for LLM-Powered Applications☆493Updated 3 months ago
- Open-source natural language enrichments at your fingertips.☆459Updated 4 months ago
- LLM fine-tuning and eval☆346Updated last year
- An LLM-powered advanced RAG pipeline built from scratch☆841Updated last year
- LLM Testing SDK that helps you write and run tests to monitor your LLM app in production☆131Updated last year
- A comprehensive guide to building RAG-based LLM applications for production.☆1,791Updated 9 months ago
- Prompt engineering for developers☆686Updated last year
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆652Updated last year
- Evaluation and Tracking for LLM Experiments☆2,501Updated this week
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,849Updated 9 months ago
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆693Updated last year
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆855Updated last year
- Classify and extract structured data with LLMs☆425Updated last year
- Large language model evaluation and workflow framework from Phase AI.☆456Updated 3 months ago
- A lightweight logger for machine learning teams to log images and predictions in production.☆152Updated 2 years ago
- Interactively explore unstructured datasets from your dataframe.☆1,175Updated this week
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆395Updated last year
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆693Updated 2 months ago
- DataDM is your private data assistant. Slide into your data's DMs☆387Updated 7 months ago
- Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML va…☆3,795Updated 2 months ago
- The simplest way to serve AI/ML models in production☆986Updated this week
- dstack is an open-source alternative to Kubernetes and Slurm, designed to simplify GPU allocation and AI workload orchestration for ML te…☆1,787Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,601Updated this week
- An open-source ML pipeline development platform☆989Updated 4 months ago
- ☆767Updated last year
- Exact structure out of any language model completion.☆508Updated last year
- Self-hardening firewall for large language models☆265Updated last year