IngestAI / deepmark
Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
☆106Updated last year
Alternatives and similar repositories for deepmark:
Users that are interested in deepmark are comparing it to the libraries listed below
- Chat strategies for LLMs☆93Updated 7 months ago
- Command-line interface for the Arcane Engine☆43Updated 4 months ago
- AI-to-AI Testing | Simulation framework for LLM-based applications☆137Updated last year
- Agent accuracy measurements for LLMs☆205Updated 9 months ago
- GUI for selecting text files for concatenation and submission to LLMs☆135Updated 4 months ago
- Action library for AI Agent☆211Updated this week
- Generate ideal question-answers for testing RAG☆126Updated 3 weeks ago
- The creative suite for character-driven AI experiences.☆185Updated 6 months ago
- Explore GitHub repositories with natural language questions☆97Updated 3 months ago
- Analyze your image in seconds with AI☆60Updated 9 months ago
- Add Siri like Native AI Agents in you App.☆54Updated 2 months ago
- This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient …☆220Updated 3 months ago
- Structured Output Is All You Need!☆54Updated last year
- An experiment to automate job search with LLMs☆89Updated last year
- ☆71Updated 11 months ago
- A simple app for downloading YouTube Shorts transcripts. Built to self-host with Python and Streamlit. Free and open source.☆27Updated 3 months ago
- Visual inference exploration & experimentation playground☆88Updated 3 months ago
- Supercompat allows you to use any AI provider like Anthropic, Groq or Mistral with OpenAI-compatible Assistants API.☆69Updated this week
- Find the Best LLM for Your Needs through E2E Testing☆79Updated 9 months ago
- RΞASON is a minimalistic Typescript framework for building great LLM apps☆49Updated 2 months ago
- AI powered cli coding agent that monitors your dev/test server and fixes errors and adds features☆196Updated 7 months ago
- Full stack voice chatbot☆197Updated 5 months ago
- Enforce structured output from LLMs 100% of the time☆248Updated 8 months ago
- A web-app to explore topics using LLM (less typing and more clicks)☆66Updated last year
- The library for character-driven AI experiences.☆89Updated 10 months ago
- ☆163Updated 8 months ago
- converts url content into JSON with a simple prefix☆67Updated 10 months ago
- Dead Simple LLM Abliteration☆211Updated last month
- Drop in replacement for OpenAI's embedding API. Self Hosted.☆53Updated last year