mrconter1 / BenchmarkAggregatorLinks
Comprehensive LLM evaluation framework: GPQA Diamond to Chatbot Arena. Tests all major models equally, easily extensible.
☆17Updated last year
Alternatives and similar repositories for BenchmarkAggregator
Users that are interested in BenchmarkAggregator are comparing it to the libraries listed below
Sorting:
- A Python library to orchestrate LLMs in a neural network-inspired structure☆52Updated last year
- Pivotal Token Search☆135Updated this week
- Tools for LLM agents.☆61Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆12Updated 10 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆62Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆91Updated 11 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆32Updated 2 months ago
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆39Updated 8 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- ☆40Updated last year
- II-Thought-RL is our initial attempt at developing a large-scale, multi-domain Reinforcement Learning (RL) dataset☆31Updated 8 months ago
- ☆107Updated last month
- Thoughtful Lightning AI Assistant - Dual-engine system with DeepSeek reasoning and Groq inference, featuring Gradio UI, secure API manage…☆20Updated 11 months ago
- ☆37Updated 4 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆66Updated last year
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆107Updated 4 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆54Updated 10 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated 2 months ago
- ☆62Updated 5 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Updated 3 months ago
- Code for WALT – Web Agents that Learn Tools☆59Updated last month
- powerful and fast tool calling agents☆79Updated 9 months ago
- Very minimal (and stateless) agent framework☆44Updated 11 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆72Updated last month
- ☆31Updated 9 months ago
- Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.☆57Updated 9 months ago
- Embed anything.☆27Updated last year
- A preprint version of our recent research on the capability of frontier AI systems to do self-replication☆60Updated last year
- LangChain + LiteLLM that works☆50Updated 3 months ago