llm-eval-simple is a simple LLM evaluation framework with intermediate actions and prompt pattern selection
☆72Feb 28, 2026Updated 6 months ago
Alternatives and similar repositories for llm-eval-simple
Users that are interested in llm-eval-simple are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Mar 2, 2026Updated 5 months ago
- Code to create your own RAG Chatbot in Databricks☆28Aug 14, 2025Updated last year
- ☆12May 30, 2025Updated last year
- Test your local LLMs on the AIME problems☆39Jun 7, 2025Updated last year
- This project benchmarks 41 open-source large language models across 19 evaluation tasks using the lm-evaluation-harness library.☆101Sep 5, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Multi-vector latent space steering adapter module for language models☆20Nov 22, 2025Updated 9 months ago
- Demo repository showing how to create a model from production traces☆17Aug 9, 2026Updated 3 weeks ago
- Open-source local AI platform for building, running, and extending AI systems with one unified runtime.☆24Updated this week
- Historical Language Model for London - A specialized LLM trained on 1500-1850 historical English text☆37Nov 1, 2025Updated 9 months ago
- Cooperate is an open-source Android app giving large language models (LLMs) the ability to interact with Android apps.☆21Jan 19, 2026Updated 7 months ago
- A minimal interface for AI Companion that runs entirely in your browser.☆209Aug 17, 2026Updated last week
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Zero-instrumentation LLM API and MCP tracer for your agents powered by eBPF — latency, tokens, and tool use in realtime☆18Mar 16, 2026Updated 5 months ago
- Roomey is a multi-purpose Voice Agent designed to run your personal and business life.☆67Jun 15, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fully local governed RAG for code, documents, and tables. No LLM API key. No GPU. No infrastructure.☆40Aug 8, 2026Updated 3 weeks ago
- ChatGPT Chrome Extension using Reactjs and TailwindCSS☆11Jan 5, 2023Updated 3 years ago
- A curated list of AI video generation APIs, SDKs, and tools including text-to-video, video editing, multimodal generation, diffusion mode…☆24Jun 17, 2026Updated 2 months ago
- ☆19Oct 25, 2025Updated 10 months ago
- ☆23May 14, 2026Updated 3 months ago
- A framework to allow unlimited text base RPG possibities.☆16Feb 18, 2026Updated 6 months ago
- Allows two LLMs to communicate and run code in the terminal☆28Dec 8, 2024Updated last year
- Graphlit Platform☆32Feb 20, 2024Updated 2 years ago
- CLIP Interrogator, fully in HuggingFace Transformers 🤗, with LongCLIP & CLIP's own words and / or *your* own words!☆19Jul 18, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A llamacpp wrapper to manage and monitor your llama server instance over a web ui.☆22Jun 16, 2026Updated 2 months ago
- A programming framework for agentic AI 🤖☆24Nov 11, 2024Updated last year
- React components & hooks for building a radial wheel menu☆25Aug 8, 2025Updated last year
- ☆22Jul 10, 2026Updated last month
- A Python script to display PNG images (e.g. from StableDiffusion) and extract prompt, negative prompt, and settings from text chunks. Off…☆22Apr 9, 2025Updated last year
- LLM-powered tooling for triaging the U.S. House Oversight & DOJ Epstein document release.☆34Mar 17, 2026Updated 5 months ago
- A GUI-first evaluation workbench for local LLMs running on Ollama. Build personal test suites, run sequential evaluations across installe…☆19Apr 20, 2026Updated 4 months ago
- ☆10May 16, 2023Updated 3 years ago
- ComfyUI custom_node to support both MoGe-2 and MoGe.☆22Mar 17, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A demonstration of metadata generation for RAG using a Health Canada document☆22Jan 19, 2025Updated last year
- The accompany backend for PAI app☆12Mar 24, 2025Updated last year
- ☆24Nov 6, 2025Updated 9 months ago
- Better Encrypted Datastore is a library for securely storing encrypted data inside Datastore. In addition, the library extends Datastore'…☆13Mar 23, 2025Updated last year
- ☆10Jul 14, 2025Updated last year
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆291Jan 6, 2026Updated 7 months ago
- 🤵 AIfred-Intelligence — self-hosted Multi-Agent Assistant with Debate Modes (Symposion/Tribunal), Voice (STT + Streaming-TTS), RAG with …☆35Updated this week