IngestAI / deepmark
Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
☆104Updated last year
Alternatives and similar repositories for deepmark:
Users that are interested in deepmark are comparing it to the libraries listed below
- Chat strategies for LLMs☆94Updated 7 months ago
- Action library for AI Agent☆212Updated 2 weeks ago
- GUI for selecting text files for concatenation and submission to LLMs☆138Updated 2 weeks ago
- Generate ideal question-answers for testing RAG☆126Updated last month
- Agent accuracy measurements for LLMs☆205Updated 10 months ago
- Find the Best LLM for Your Needs through E2E Testing☆80Updated 10 months ago
- Command-line interface for the Arcane Engine☆44Updated 5 months ago
- ☆71Updated last year
- The creative suite for character-driven AI experiences.☆184Updated 7 months ago
- AI-to-AI Testing | Simulation framework for LLM-based applications☆137Updated last year
- Explore GitHub repositories with natural language questions☆97Updated 3 months ago
- Analyze your image in seconds with AI☆60Updated 10 months ago
- OmiAI is an opinionated AI SDK for Typescript that auto-picks the best model from a suite of curated models depending on the prompt. It i…☆97Updated 2 months ago
- The library for character-driven AI experiences.☆89Updated 10 months ago
- Structured Output Is All You Need!☆57Updated last year
- Data Encoding and Representation Analysis☆40Updated last year
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆220Updated 3 months ago
- ☆162Updated 9 months ago
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆158Updated last year
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆174Updated last year
- Remote execution made easy☆58Updated 11 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆222Updated 3 months ago
- Enforce structured output from LLMs 100% of the time☆249Updated 8 months ago
- Full stack voice chatbot☆197Updated 6 months ago
- A chat-based platform for API discovery and testing☆47Updated this week
- RΞASON is a minimalistic Typescript framework for building great LLM apps☆49Updated 3 months ago
- Your friendly terminal-based AI pair programmer☆42Updated last year
- iauto is a low-code engine for building and deploying AI agents☆85Updated 4 months ago
- An experiment to automate job search with LLMs☆89Updated last year
- ☆47Updated last year