uptrain-ai / uptrainLinks
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
☆2,292Updated 10 months ago
Alternatives and similar repositories for uptrain
Users that are interested in uptrain are comparing it to the libraries listed below
Sorting:
- Data-Driven Evaluation for LLM-Powered Applications☆500Updated 5 months ago
- The simplest way to serve AI/ML models in production☆1,022Updated this week
- Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.☆846Updated 8 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,894Updated 10 months ago
- AIConfig is a config-based framework to build generative AI applications.☆1,034Updated last year
- Adding guardrails to large language models.☆5,229Updated last month
- An LLM-powered advanced RAG pipeline built from scratch☆842Updated last year
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆694Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆925Updated 7 months ago
- A tool for evaluating LLMs☆424Updated last year
- Turn expensive prompts into cheap fine-tuned models☆2,639Updated last year
- Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)☆396Updated last year
- LLM Testing SDK that helps you write and run tests to monitor your LLM app in production☆131Updated last year
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,338Updated this week
- LLM fine-tuning and eval☆344Updated last year
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆698Updated 4 months ago
- Scale LLM Engine public repository☆808Updated last week
- Interactively explore unstructured datasets from your dataframe.☆1,185Updated last month
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆859Updated last year
- dstack is an open-source container orchestrator that simplifies workload orchestration and drives GPU utilization for ML teams. It works …☆1,827Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,717Updated this week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,800Updated 11 months ago
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆663Updated last year
- 🤖 Deploy a private ChatGPT alternative hosted within your VPC. 🔮 Connect it to your organization's knowledge base and use it as a corpo…☆1,499Updated last year
- LLM(😽)☆1,682Updated 5 months ago
- An open-source ML pipeline development platform☆994Updated 6 months ago
- Custom AI assistant platform to speed up your work.☆1,161Updated this week
- Prompt engineering for developers☆688Updated last year
- Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and…☆2,185Updated last week
- 🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and mo…☆1,065Updated 6 months ago