Alternatives and similar repositories for core-bench

Users that are interested in core-bench are comparing it to the libraries listed below

• princeton-pli / hal-harness
  ☆89Updated this week
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆173Updated 3 months ago
• allenai / discoveryworld
  A virtual environment for developing and evaluating automated scientific discovery agents.
  ☆156Updated 2 months ago
• BigComputer-Project / SWE-Arena
  SWE Arena
  ☆33Updated last month
• OSU-NLP-Group / ScienceAgentBench
  [ICLR'25] ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery
  ☆87Updated last month
• LeonGuertler / TextArena
  A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning
  ☆173Updated this week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆93Updated 3 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆204Updated 3 weeks ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆201Updated last month
• LiqiangJing / DSBench
  DSBench: How Far are Data Science Agents from Becoming Data Science Experts?
  ☆54Updated 3 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆89Updated 6 months ago
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆271Updated 4 months ago
• THUDM / ComplexFuncBench
  Complex Function Calling Benchmark.
  ☆112Updated 4 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆215Updated last month
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated 9 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆79Updated 3 months ago
• scicode-bench / SciCode
  A benchmark that challenges language models to code solutions for scientific problems
  ☆123Updated this week
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆87Updated last month
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆81Updated 8 months ago
• vsubramaniam851 / multiagent-ft
  ☆205Updated 3 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆78Updated 8 months ago
• spcl / x1
  Official Implementation of "Reasoning Language Models: A Blueprint"
  ☆62Updated 3 months ago
• sunblaze-ucb / reasoning_ladder
  ☆30Updated 3 weeks ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆104Updated last month
• AkariAsai / ScholarQABench
  This repository contains ScholarQABench data and evaluation pipeline.
  ☆72Updated last month
• kohjingyu / search-agents
  Code for the paper 🌳 Tree Search for Language Model Agents
  ☆200Updated 10 months ago
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆235Updated 8 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆156Updated last year
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆41Updated 7 months ago
• aymeric-roucher / agent_reasoning_benchmark
  🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
  ☆97Updated 7 months ago