IngestAI / deepmark
Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
☆106Updated last year
Alternatives and similar repositories for deepmark:
Users that are interested in deepmark are comparing it to the libraries listed below
- Chat strategies for LLMs☆93Updated 6 months ago
- Generate ideal question-answers for testing RAG☆126Updated 2 weeks ago
- Action library for AI Agent☆211Updated this week
- GUI for selecting text files for concatenation and submission to LLMs☆135Updated 4 months ago
- Find the Best LLM for Your Needs through E2E Testing☆78Updated 9 months ago
- AI-to-AI Testing | Simulation framework for LLM-based applications☆137Updated last year
- Analyze your image in seconds with AI☆60Updated 9 months ago
- The creative suite for character-driven AI experiences.☆185Updated 6 months ago
- Command-line interface for the Arcane Engine☆43Updated 4 months ago
- Praetor is a lightweight finetuning data and prompt management tool☆68Updated 3 months ago
- RAG Logger is an open-source logging tool designed specifically for Retrieval-Augmented Generation (RAG) applications. It serves as a lig…☆220Updated 2 months ago
- Explore GitHub repositories with natural language questions☆97Updated 2 months ago
- Structured Output Is All You Need!☆54Updated 11 months ago
- Agent accuracy measurements for LLMs☆205Updated 8 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆219Updated 2 months ago
- ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…☆168Updated 4 months ago
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆174Updated 11 months ago
- Full stack voice chatbot☆196Updated 5 months ago
- Enforce structured output from LLMs 100% of the time☆247Updated 7 months ago
- Open source framework for using LLMs to forecast political, economic, and social events.☆70Updated last week
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆158Updated 11 months ago
- iauto is a low-code engine for building and deploying AI agents☆85Updated 3 months ago
- ☆71Updated 11 months ago
- A collection of tamagotchi characters to give AI assistants an identity.☆53Updated 4 months ago
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆27Updated 3 months ago
- An experiment to automate job search with LLMs☆89Updated last year
- Tools for LLM agents.☆59Updated 2 months ago