llm-eval-simple is a simple LLM evaluation framework with intermediate actions and prompt pattern selection
☆72Feb 28, 2026Updated 6 months ago
Alternatives and similar repositories for llm-eval-simple
Users that are interested in llm-eval-simple are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 7 months ago
- ☆20Apr 19, 2026Updated 5 months ago
- ☆31Mar 2, 2026Updated 6 months ago
- Code to create your own RAG Chatbot in Databricks☆28Aug 14, 2025Updated last year
- A local-first LLM development studio. Build, test, and customize inference workflows with your own models — no cloud, totally local.☆17May 21, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12May 30, 2025Updated last year
- Test your local LLMs on the AIME problems☆39Jun 7, 2025Updated last year
- This project benchmarks 41 open-source large language models across 19 evaluation tasks using the lm-evaluation-harness library.☆101Sep 5, 2025Updated last year
- Multi-vector latent space steering adapter module for language models☆20Nov 22, 2025Updated 9 months ago
- Demo repository showing how to create a model from production traces☆17Updated this week
- Historical Language Model for London - A specialized LLM trained on 1500-1850 historical English text☆38Nov 1, 2025Updated 10 months ago
- Cooperate is an open-source Android app giving large language models (LLMs) the ability to interact with Android apps.☆21Jan 19, 2026Updated 8 months ago
- This provide A Zero-Server Web Interface for use with Ollama local LLM's and provides AI search via Perplexity (API Key required) and ima…☆32Updated this week
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Vörður doesn't protect LLMs. It protects the companies that use them.☆19Sep 7, 2026Updated last week
- Fully local governed RAG for code, documents, and tables. No LLM API key. No GPU. No infrastructure.☆41Aug 8, 2026Updated last month
- A modern, single-page web chat interface for local LLMs (Large Language Models), inspired by the visual style and UX of Anthropic's Claud…☆32May 11, 2025Updated last year
- A curated list of AI video generation APIs, SDKs, and tools including text-to-video, video editing, multimodal generation, diffusion mode…☆27Jun 17, 2026Updated 3 months ago
- An artificial life experiment.☆12Jul 30, 2020Updated 6 years ago
- ☆19Oct 25, 2025Updated 10 months ago
- ☆23May 14, 2026Updated 4 months ago
- Tools for basic array manipulation and help dealing with the different flavors of arrays in Julia☆12Jul 15, 2026Updated 2 months ago
- 72 AI Agent Skills for Manus - Properly formatted for direct import☆31Mar 10, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Allows two LLMs to communicate and run code in the terminal☆28Dec 8, 2024Updated last year
- A llamacpp wrapper to manage and monitor your llama server instance over a web ui.☆27Jun 16, 2026Updated 3 months ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Aug 15, 2026Updated last month
- ☆23Dec 12, 2025Updated 9 months ago
- Quickly turn Windows HDR on/off with a hotkey☆17Jan 13, 2021Updated 5 years ago
- ☆22Jul 10, 2026Updated 2 months ago
- GitHub bot that validates patches before they can be merged☆18Jun 26, 2018Updated 8 years ago
- AI-powered text compression library for RAG systems and API calls. Reduce token usage by up to 50-60% while preserving semantic meaning w…☆90Aug 16, 2025Updated last year
- One device to rule them all...☆11May 25, 2016Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LLM-powered tooling for triaging the U.S. House Oversight & DOJ Epstein document release.☆34Sep 5, 2026Updated 2 weeks ago
- Capture, tag, and search images locally with OSS models.☆45Jan 19, 2025Updated last year
- ML experiment tracker. Simple alternative for neptune.ai or Tensorboard.☆18Apr 11, 2026Updated 5 months ago
- Trion Core☆15Jan 2, 2026Updated 8 months ago
- ☆10May 16, 2023Updated 3 years ago
- ☆31Aug 24, 2026Updated 3 weeks ago
- Paperclip plugin: bidirectional GitHub Issues sync☆28Mar 20, 2026Updated 6 months ago