simonw / llm-evals-plugin
Run evals using LLM
☆22Updated 11 months ago
Alternatives and similar repositories for llm-evals-plugin:
Users that are interested in llm-evals-plugin are comparing it to the libraries listed below
- Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.☆50Updated 6 months ago
- Handout for a talk I gave about LLM and CLI tools☆62Updated 10 months ago
- ☆67Updated 5 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆33Updated this week
- A Chrome extension that saves conversations with Claude to GitHubGists or your clipboard.☆82Updated 4 months ago
- Minimal example of MCP for parsing llms.txt☆33Updated last week
- ☆19Updated 6 months ago
- Embedding models from Jina AI☆58Updated last year
- Run embedding models using ONNX☆31Updated last year
- Access the Cohere Command R family of models☆36Updated 2 weeks ago
- Tools for LLM agents.☆62Updated 3 months ago
- Get a markdown version of any webpage with a keyboard shortcut.☆62Updated last month
- Using modal.com to process FineWeb-edu data☆20Updated last week
- A cookiecutter template for building plugins for LLM☆21Updated this week
- LLM plugin for models hosted by Anyscale Endpoints☆33Updated 11 months ago
- Chat Markup Language conversation library☆55Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 8 months ago
- ☆31Updated last year
- A collection of tools for your LLMs that run on Modal☆18Updated last month
- Writing Blog Posts with Generative Feedback Loops!☆47Updated last year
- Demos of ChatGPT's function calling/structured data support.☆23Updated last year
- Repo to experiment with Graph RAG strategies using Kùzu☆51Updated 4 months ago
- Aider's refactoring benchmark exercises based on popular python repos☆65Updated 6 months ago
- Verbosity control for AI agents☆61Updated 10 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated this week
- ☆4Updated 7 months ago
- Plugin for LLM adding a Markov chain generating model☆19Updated 9 months ago
- ☆78Updated 10 months ago
- Run transcriptions using the OpenAI Whisper API☆21Updated 5 months ago
- auto fine tune of models with synthetic data☆75Updated last year