Alternatives and similar repositories for BenchmarkAggregator

Users that are interested in BenchmarkAggregator are comparing it to the libraries listed below

• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated 7 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆50Updated 11 months ago
• QuixiAI / dolphin-logger
  ☆104Updated 2 months ago
• WhitzardIndex / self-replication-research
  A preprint version of our recent research on the capability of frontier AI systems to do self-replication
  ☆59Updated 8 months ago
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆106Updated last month
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆54Updated 4 months ago
• lechmazur / pgg_bench
  Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…
  ☆38Updated 4 months ago
• MaximeRivest / ovllm
  ☆30Updated last month
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆54Updated 5 months ago
• charmandercha / ArchiDoc
  ☆17Updated 8 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆64Updated last year
• kenhktsui / anyclassifier
  One Line To Build Zero-Data Classifiers in Minutes
  ☆58Updated 11 months ago
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆12Updated 6 months ago
• ArturTanona / grpo_unsloth_docker
  ☆57Updated 6 months ago
• miralab-ai / autoreason
  ☆40Updated 8 months ago
• codelion / pts
  Pivotal Token Search
  ☆123Updated last month
• shane-kercheval / mcp-client-agent
  CLI that uses DSPy to interact with MCP servers.
  ☆23Updated 5 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆85Updated 5 months ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆68Updated last year
• cgftinc / benchmax
  Framework-Agnostic RL Environments for LLM Fine-Tuning
  ☆34Updated this week
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆55Updated 9 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆56Updated 6 months ago
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆45Updated 7 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 9 months ago
• GoodAI / goodai-ltm-benchmark
  A library for benchmarking the Long Term Memory and Continual learning capabilities of LLM based agents. With all the tests and code you…
  ☆76Updated 8 months ago
• Osmosis-AI / Osmosis-Apply-1.7B-MCP
  A mcp server that uses the Osmosis-Apply-1.7B model to apply code merges
  ☆51Updated 2 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆29Updated 8 months ago
• reka-ai / rekaquant
  ☆60Updated last month