IngestAI / deepmark
Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
☆105Updated last year
Alternatives and similar repositories for deepmark:
Users that are interested in deepmark are comparing it to the libraries listed below
- Chat strategies for LLMs☆92Updated 6 months ago
- Generate ideal question-answers for testing RAG☆126Updated 2 weeks ago
- Action library for AI Agent☆209Updated this week
- GUI for selecting text files for concatenation and submission to LLMs☆135Updated 3 months ago
- Find the Best LLM for Your Needs through E2E Testing☆78Updated 8 months ago
- Structured Output Is All You Need!☆53Updated 11 months ago
- AI-to-AI Testing | Simulation framework for LLM-based applications☆137Updated last year
- An experiment to automate job search with LLMs☆89Updated last year
- Explore GitHub repositories with natural language questions☆94Updated last month
- Agent accuracy measurements for LLMs☆205Updated 8 months ago
- Enforce structured output from LLMs 100% of the time☆246Updated 7 months ago
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆157Updated 10 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆217Updated 2 months ago
- The library for character-driven AI experiences.☆89Updated 9 months ago
- Command-line interface for the Arcane Engine☆43Updated 3 months ago
- Analyze your image in seconds with AI☆60Updated 8 months ago
- Praetor is a lightweight finetuning data and prompt management tool☆67Updated 3 months ago
- Visual inference exploration & experimentation playground☆87Updated 2 months ago
- The creative suite for character-driven AI experiences.☆184Updated 5 months ago
- Open source framework for using LLMs to forecast political, economic, and social events.☆69Updated this week
- Remote execution made easy☆59Updated 9 months ago
- An open source alternative to some of Slack AI's premium features. Summarize channels and threads any time you want.☆160Updated 3 months ago
- AI search: your data + 10 lines of code.☆75Updated 6 months ago
- Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.☆273Updated last month
- Replace expensive LLM calls with finetunes automatically☆62Updated last year
- ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…☆163Updated 3 months ago
- iauto is a low-code engine for building and deploying AI agents☆84Updated 2 months ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆136Updated last year